Jul 08 03:18:52 devstack cinder-volume[75401]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 03:18:52 devstack cinder-volume[75401]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 03:18:52 devstack cinder-volume[75401]: we strongly recommend against using it for new projects. Jul 08 03:18:52 devstack cinder-volume[75401]: If you are already using Eventlet, we recommend migrating to a different Jul 08 03:18:52 devstack cinder-volume[75401]: framework. For more detail see Jul 08 03:18:52 devstack cinder-volume[75401]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 03:18:52 devstack cinder-volume[75401]: import eventlet # noqa Jul 08 03:18:55 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:18:55 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:18:55 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:18:55 devstack cinder-volume[75401]: INFO dbcounter [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Registered counter for database cinder Jul 08 03:18:55 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:18:56 devstack cinder-volume[75401]: DEBUG dbcounter [-] [75401] Writer thread running {{(pid=75401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 03:18:56 devstack cinder-volume[75401]: INFO cinder.rpc [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 03:18:56 devstack cinder-volume[75401]: INFO cinder.rpc [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 03:18:56 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:18:56 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Determined volume DB was empty at startup. Jul 08 03:18:56 devstack cinder-volume[75401]: DEBUG cinder.volume.manager [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75401) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 03:18:56 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 03:18:56 devstack cinder-volume[75401]: WARNING stevedore.named [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 03:18:56 devstack cinder-volume[75401]: WARNING castellan.key_manager [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:18:56 devstack cinder-volume[75401]: WARNING cinder.keymgr.conf_key_mgr [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:18:56 devstack cinder-volume[75401]: DEBUG cinder.volume.drivers.lvm [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75401) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 03:18:56 devstack cinder-volume[75401]: DEBUG oslo_concurrency.processutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_concurrency.processutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] CMD "cinder-rtstool verify" returned: 0 in 0.404s {{(pid=75401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:18:57 devstack cinder-volume[75401]: INFO cinder.rpc [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 03:18:57 devstack cinder-volume[75401]: INFO cinder.rpc [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 03:18:57 devstack cinder-volume[75401]: WARNING stevedore.named [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 03:18:57 devstack cinder-volume[75401]: WARNING castellan.key_manager [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:18:57 devstack cinder-volume[75401]: INFO cinder.volume.manager [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_db.sqlalchemy.engines [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:18:57 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Starting 1 workers Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Started child 75560 {{(pid=75401) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Full set of CONF: {{(pid=75401) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] ******************************************************************************** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Configuration options gathered from: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] ================================================================================ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] allow_availability_zone_fallback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] allow_compression_on_image_upload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] allowed_direct_url_schemes = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] api_rate_limit = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] auth_strategy = keystone {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] az_cache_duration = 3600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_host = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_stats_polling_interval = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backup_api_class = cinder.backup.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backup_name_template = backup-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backup_use_same_host = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backup_use_temp_snapshot = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] chap_username = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_internal_tenant_project_id = 5ecf51ecd30e4f32834a6d0737643b42 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_internal_tenant_user_id = 4501c915262d4570a09b37db917d97c1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cloned_volume_same_az = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cluster = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] compression_format = gzip {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] compute_api_class = cinder.compute.nova.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] config_dir = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] config_source = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] control_exchange = openstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] debug = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] default_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75560]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] default_group_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] default_volume_type = lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] driver_ssl_cert_verify = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] driver_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] enable_force_upload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] enable_new_services = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] enable_unsupported_driver = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] enabled_backends = ['lvmdriver-1'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] enforce_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_api_insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_api_ssl_compression = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_ca_certificates_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_catalog_info = image:glance:publicURL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_num_retries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance_request_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] graceful_shutdown_timeout = 5 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] group_api_class = cinder.group.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] host = devstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_compress_on_upload = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_conversion_address_space_limit = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_conversion_cpu_limit = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_conversion_disable = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_upload_use_cinder_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_upload_use_internal_tenant = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_volume_cache_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_volume_cache_max_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] image_volume_cache_max_size_gb = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] init_host_max_objects_retrieval = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] instance_format = [instance: %(uuid)s] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] iscsi_target_flags = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] iscsi_write_cache = on {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] iser_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] iser_ip_address = 192.168.122.200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] iser_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_color = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_config_append = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_dir = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_options = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_rotate_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_rotate_interval_type = days {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] log_rotation_type = none {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] max_age = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] max_logfile_count = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] max_logfile_size_mb = 200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] max_over_subscription_ratio = 20.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] message_reap_interval = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] message_ttl = 2592000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] migration_create_volume_timeout_secs = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] monkey_patch = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] monkey_patch_modules = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] my_ip = 192.168.122.200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] no_snapshot_gb_quota = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] num_iser_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] num_shell_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] num_volume_device_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] nvmeof_conn_info_version = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] nvmet_ns_id = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] nvmet_port_id = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_max_limit = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_volume_ext_list = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_volume_listen = 0.0.0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_volume_listen_port = 8776 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_volume_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] osapi_volume_workers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] per_volume_size_limit = -1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] periodic_fuzzy_delay = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] periodic_interval = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] project_id_regex = [0-9a-f\-]+ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] public_endpoint = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] publish_errors = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_backup_gigabytes = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_backups = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_gigabytes = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_groups = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_snapshots = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] quota_volumes = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] rate_limit_burst = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] rate_limit_except_level = CRITICAL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] rate_limit_interval = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] reinit_driver_count = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] report_discard_supported = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] report_interval = 120 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] reservation_clean_interval = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] reservation_expire = 86400 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] reserved_image_namespaces = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] reserved_percentage = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] rpc_response_timeout = 120 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] run_external_periodic_tasks = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] scst_target_driver = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_down_time = 720 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] shell_completion = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] snapshot_name_template = snapshot-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] snapshot_same_host = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] state_path = /opt/stack/data/cinder {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] storage_availability_zone = nova {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] storage_protocol = iSCSI {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] syslog_log_facility = LOG_USER {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] target_helper = lioadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] target_ip_address = 192.168.122.200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] target_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] target_secondary_ip_addresses = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] trace_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] transfer_api_class = cinder.transfer.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] transport_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] until_refresh = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_chap_auth = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_default_quota_class = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_journal = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_json = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_stderr = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] use_syslog = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] verify_glance_signatures = enabled {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_api_class = cinder.volume.api.API {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_clear = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_clear_size = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_copy_bps_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_dd_blocksize = 1M {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_name_template = volume-%s {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_service_inithost_offload = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volume_usage_audit_period = month {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] zoning_mode = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_concurrency.disable_process_locking = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.auth_type = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.auth_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.cache = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.include_service_catalog = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.interface = public {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_password = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcache_username = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.service_token_roles_required = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.service_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.backend = dogpile.cache.null {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.backend_argument = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.backend_expiration_time = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.config_prefix = cache.oslo {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.debug_cache_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.enable_retry_client = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.enable_socket_keepalive = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.expiration_time = 600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.hashclient_retry_attempts = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_dead_retry = 300 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_pool_maxsize = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_sasl_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.proxies = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.redis_db = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.redis_server = localhost:6379 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.retry_attempts = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.retry_delay = 0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.socket_keepalive_count = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.socket_keepalive_idle = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.socket_keepalive_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.socket_timeout = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.tls_allowed_ciphers = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.tls_cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.tls_certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.tls_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.tls_keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cache.username = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] coordination.backend_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.asyncio_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.asyncio_slave_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.backend = sqlalchemy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.connection_debug = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.connection_parameters = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.connection_recycle_time = 3600 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.connection_trace = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.db_inc_retry_interval = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.db_max_retries = 20 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.db_max_retry_interval = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.db_retry_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.max_overflow = 50 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.max_pool_size = 5 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.max_retries = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.mysql_wsrep_sync_wait = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.pool_timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.retry_interval = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.slave_connection = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.sqlite_synchronous = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.synchronous_reader = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] database.use_db_reconnect = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.connection_string = messaging:// {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.es_doc_type = notification {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.es_scroll_size = 10000 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.es_scroll_time = 2m {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.filter_error_trace = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.hmac_keys = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.sentinel_service_name = mymaster {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack sudo[75566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.socket_timeout = 0.1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.trace_requests = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler.trace_sqlalchemy = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler_jaeger.process_tags = {} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler_jaeger.service_name_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] profiler_otlp.service_name_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack sudo[75566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.enforce_new_defaults = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.enforce_scope = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.policy_default_rule = default {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.policy_file = policy.yaml {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_policy.remote_timeout = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.group = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.helper_command = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] privsep_osbrick.user = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.group = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.helper_command = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] cinder_sys_admin.user = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.auth_type = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.send_service_user_token = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] service_user.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.auth_type = password {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] glance.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.chap_username = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.driver_use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.extra_capabilities = {} {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.iscsi_target_flags = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.iscsi_write_cache = on {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.iser_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.iser_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.lvm_mirrors = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.lvm_share_target = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.lvm_type = auto {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.num_shell_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.report_discard_supported = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.reserved_percentage = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.target_helper = tgtadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.target_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.trace_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.unique_fqdn_network = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.use_chap_auth = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_backend_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_clear = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_clear_size = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volume_group = cinder-volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_reports.file_event_handler = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_reports.log_dir = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.backend_host = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.chap_password = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.chap_username = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.chiscsi_conf = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.disk_geometry = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.driver_client_cert = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.driver_use_ssl = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.extra_capabilities = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.filter_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.goodness_function = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.iser_helper = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.iser_ip_address = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.iser_port = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.lvm_conf_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.lvm_mirrors = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.lvm_share_target = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.lvm_type = auto {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.num_shell_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.nvmet_port_id = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.replication_device = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.report_discard_supported = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.reserved_percentage = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.scst_target_driver = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.storage_protocol = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.target_helper = lioadm {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.target_ip_address = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.target_port = 3260 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.target_protocol = iscsi {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.trace_flags = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.use_chap_auth = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_clear = zero {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_clear_size = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] lvmdriver-1.volumes_dir = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.ssl_version = {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_notifications.driver = [] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_notifications.retry = -1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] key_manager.fixed_key = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.barbican_api_version = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.barbican_endpoint = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.barbican_endpoint_type = public {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.barbican_region_name = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.number_of_retries = 60 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.retry_delay = 1 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.send_service_user_token = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.verify_ssl = True {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican.verify_ssl_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.auth_section = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.auth_type = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.cafile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.certfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.collect_timing = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.insecure = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.keyfile = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.split_loggers = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] barbican_service_user.timeout = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.approle_role_id = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.approle_secret_id = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.kv_mountpoint = secret {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.kv_path = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.kv_version = 2 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.namespace = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.root_token_id = **** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.ssl_ca_crt_file = None {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.timeout = 60.0 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.use_ssl = False {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:18:57 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] ******************************************************************************** {{(pid=75401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 03:18:58 devstack sudo[75566]: pam_unix(sudo:session): session closed for user root Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:58 devstack sudo[75698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:18:58 devstack sudo[75698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:18:58 devstack sudo[75698]: pam_unix(sudo:session): session closed for user root Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.672s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:18:58 devstack cinder-volume[75560]: INFO cinder.brick.local_dev.lvm [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:58 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:58 devstack sudo[75932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:18:58 devstack sudo[75932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:18:59 devstack sudo[75932]: pam_unix(sudo:session): session closed for user root Jul 08 03:18:59 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:18:59 devstack cinder-volume[75560]: DEBUG cinder.brick.local_dev.lvm [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75560) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 03:18:59 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:18:59 devstack sudo[76130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:18:59 devstack sudo[76130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:00 devstack sudo[76130]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:00 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.244s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:00 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:00 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:00 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:00 devstack sudo[76327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:00 devstack sudo[76327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:01 devstack sudo[76327]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:01 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:01 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:01 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:01 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:01 devstack sudo[76344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 03:19:01 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:02 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:02 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.692s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:02 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:02 devstack sudo[76348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:19:02 devstack sudo[76348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:02 devstack sudo[76348]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:02 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.817s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:02 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:03 devstack sudo[76358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:19:03 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:03 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:03 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:03 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:03 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:03 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:04 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:04 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.845s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:04 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:04 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:04 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:05 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:05 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:05 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:05 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:05 devstack cinder-volume[75560]: INFO cinder.volume.drivers.lvm [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:05 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:05 devstack sudo[76389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:05 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:06 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:06 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.780s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:06 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:19:06 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:06 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:19:06 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:07 devstack cinder-volume[75401]: DEBUG dbcounter [-] [75401] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:19:07 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:07 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:07 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:07 devstack sudo[76638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:07 devstack sudo[76638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:08 devstack sudo[76638]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:08 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:08 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:08 devstack sudo[76648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:08 devstack sudo[76648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:08 devstack sudo[76648]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:08 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:08 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:08 devstack sudo[76651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:08 devstack sudo[76651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:09 devstack sudo[76651]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:09 devstack cinder-volume[75560]: INFO cinder.volume.driver [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG cinder.volume.driver [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75560) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG oslo_db.sqlalchemy.engines [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writer thread running {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG cinder.db.api [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Building query based on filter {{(pid=75560) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG cinder.image.image_utils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75560) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 03:19:09 devstack cinder-volume[75560]: INFO cinder.keymgr.migration [None req-5b21a739-ed73-4d30-9ba7-c2505b3ed480 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:19:09 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:09 devstack sudo[76658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:19:09 devstack sudo[76658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:10 devstack sudo[76658]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:10 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:10 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:10 devstack sudo[76663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:10 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:10 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:10 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:10 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:10 devstack sudo[76667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:10 devstack sudo[76667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:11 devstack sudo[76667]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:11 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:11 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:11 devstack sudo[76670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:11 devstack sudo[76670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:12 devstack sudo[76670]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:12 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:12 devstack cinder-volume[75560]: DEBUG cinder.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Notifying Schedulers of capabilities ... {{(pid=75560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:19:12 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Driver initialization completed successfully. Jul 08 03:19:12 devstack cinder-volume[75560]: INFO cinder.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Initiating service 2 cleanup Jul 08 03:19:12 devstack cinder-volume[75560]: INFO cinder.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Service 2 cleanup completed. Jul 08 03:19:12 devstack cinder-volume[75560]: DEBUG cinder.service [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Creating RPC server for service cinder-volume {{(pid=75560) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 03:19:12 devstack cinder-volume[75560]: DEBUG cinder.service [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75560) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 03:19:12 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 03:19:12 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:19:12 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:12 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:19:12 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:13 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:13 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:13 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:13 devstack sudo[76678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:13 devstack sudo[76678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:13 devstack sudo[76678]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:13 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:13 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:13 devstack sudo[76684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:19:13 devstack sudo[76684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:14 devstack sudo[76684]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:14 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:14 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:19:14 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:19:14 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:19:14 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Jul 08 03:19:14 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:19:14 devstack cinder-volume[75560]: INFO cinder.volume.manager [None req-2875fcfa-2f5f-4fed-ad1f-ca1dabcb05b3 None None] Driver post RPC initialization completed successfully. Jul 08 03:19:24 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:19:25 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:19:30 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager._thread_info {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:19:31 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread count: 6 {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:19:31 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread info: [<_MainThread(MainThread, started 124553519079552)>, , , , , ] {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:20:31 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:20:31 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:20:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:20:31 devstack sudo[79086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:20:31 devstack sudo[79086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:20:31 devstack sudo[79086]: pam_unix(sudo:session): session closed for user root Jul 08 03:20:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:20:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:20:31 devstack sudo[79089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:20:31 devstack sudo[79089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:20:32 devstack sudo[79089]: pam_unix(sudo:session): session closed for user root Jul 08 03:20:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:20:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:20:32 devstack sudo[79092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:20:32 devstack sudo[79092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:20:32 devstack sudo[79092]: pam_unix(sudo:session): session closed for user root Jul 08 03:20:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:20:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:20:32 devstack sudo[79095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:20:32 devstack sudo[79095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:20:33 devstack sudo[79095]: pam_unix(sudo:session): session closed for user root Jul 08 03:20:33 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:20:33 devstack cinder-volume[75560]: DEBUG cinder.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Notifying Schedulers of capabilities ... {{(pid=75560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:20:33 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager._thread_info {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:20:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread count: 6 {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:20:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread info: [<_MainThread(MainThread, started 124553519079552)>, , , , , ] {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:21:25 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:SELECT=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:21:25 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:UPDATE=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:21:31 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:21:31 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:21:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:21:31 devstack sudo[82079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:21:31 devstack sudo[82079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:21:31 devstack sudo[82079]: pam_unix(sudo:session): session closed for user root Jul 08 03:21:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:21:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:21:31 devstack sudo[82082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:21:31 devstack sudo[82082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:21:32 devstack sudo[82082]: pam_unix(sudo:session): session closed for user root Jul 08 03:21:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:21:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:21:32 devstack sudo[82085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:21:32 devstack sudo[82085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:21:33 devstack sudo[82085]: pam_unix(sudo:session): session closed for user root Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:21:33 devstack sudo[82088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:21:33 devstack sudo[82088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:21:33 devstack sudo[82088]: pam_unix(sudo:session): session closed for user root Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG cinder.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Notifying Schedulers of capabilities ... {{(pid=75560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager._thread_info {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread count: 6 {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:21:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread info: [<_MainThread(MainThread, started 124553519079552)>, , , , , ] {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:22:31 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:22:31 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:22:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:22:31 devstack sudo[84321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:22:31 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:22:31 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root Jul 08 03:22:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:22:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:22:31 devstack sudo[84324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:22:31 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:22:32 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root Jul 08 03:22:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:22:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:22:32 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:22:32 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:22:32 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Jul 08 03:22:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:22:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:22:32 devstack sudo[84333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:22:32 devstack sudo[84333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:22:33 devstack sudo[84333]: pam_unix(sudo:session): session closed for user root Jul 08 03:22:33 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:22:33 devstack cinder-volume[75560]: DEBUG cinder.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Notifying Schedulers of capabilities ... {{(pid=75560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:22:33 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager._thread_info {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:22:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread count: 6 {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:22:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread info: [<_MainThread(MainThread, started 124553519079552)>, , , , , ] {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:23:25 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:SELECT=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:23:25 devstack cinder-volume[75560]: DEBUG dbcounter [-] [75560] Writing DB stats cinder:UPDATE=1 {{(pid=75560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:23:31 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:23:31 devstack cinder-volume[75560]: DEBUG cinder.volume.drivers.lvm [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Updating volume stats {{(pid=75560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 03:23:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:31 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 03:23:31 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:31 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:31 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:31 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:23:31 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:32 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:32 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 03:23:32 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:32 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:32 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:33 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 03:23:33 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:33 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Caught SIGTERM, stopping children Jul 08 03:23:33 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Acquiring lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:23:33 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Acquired lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:23:33 devstack cinder-volume[75401]: DEBUG oslo_concurrency.lockutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Releasing lock "singleton_lock" {{(pid=75401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:23:33 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Stop services. {{(pid=75401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 03:23:33 devstack cinder-volume[75401]: DEBUG oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Killing children. {{(pid=75401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 03:23:33 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Waiting on 1 children to exit Jul 08 03:23:33 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:33 devstack cinder-volume[75560]: DEBUG oslo_concurrency.processutils [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:33 devstack cinder-volume[75560]: DEBUG cinder.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Notifying Schedulers of capabilities ... {{(pid=75560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:23:33 devstack cinder-volume[75560]: DEBUG oslo_service.periodic_task [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] Running periodic task VolumeManager._thread_info {{(pid=75560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:23:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread count: 6 {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:23:33 devstack cinder-volume[75560]: DEBUG cinder.volume.manager [None req-9ef556d2-3dc2-45da-9a2d-f9a3bff20fda None None] thread info: [<_MainThread(MainThread, started 124553519079552)>, , , , , ] {{(pid=75560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:23:37 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Acquiring lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:23:37 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Acquired lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:23:37 devstack cinder-volume[75560]: DEBUG oslo_concurrency.lockutils [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Releasing lock "singleton_lock" {{(pid=75560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:23:37 devstack cinder-volume[75560]: WARNING amqp [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 03:23:37 devstack cinder-volume[75560]: WARNING amqp [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 03:23:37 devstack cinder-volume[75401]: INFO oslo_service.backend._eventlet.service [None req-6f2d39d6-f60a-434b-a842-f8b84e07837e None None] Child 75560 exited with status 0 Jul 08 03:23:37 devstack cinder-volume[85682]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 03:23:37 devstack cinder-volume[85682]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 03:23:37 devstack cinder-volume[85682]: we strongly recommend against using it for new projects. Jul 08 03:23:37 devstack cinder-volume[85682]: If you are already using Eventlet, we recommend migrating to a different Jul 08 03:23:37 devstack cinder-volume[85682]: framework. For more detail see Jul 08 03:23:37 devstack cinder-volume[85682]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 03:23:37 devstack cinder-volume[85682]: import eventlet # noqa Jul 08 03:23:39 devstack cinder-volume[85682]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:23:39 devstack cinder-volume[85682]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:23:39 devstack cinder-volume[85682]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:23:40 devstack cinder-volume[85682]: INFO dbcounter [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Registered counter for database cinder Jul 08 03:23:40 devstack cinder-volume[85682]: DEBUG oslo_db.sqlalchemy.engines [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:40 devstack cinder-volume[85682]: DEBUG dbcounter [-] [85682] Writer thread running {{(pid=85682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 03:23:40 devstack cinder-volume[85682]: INFO cinder.rpc [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 03:23:40 devstack cinder-volume[85682]: INFO cinder.rpc [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 03:23:40 devstack cinder-volume[85682]: DEBUG oslo_db.sqlalchemy.engines [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:40 devstack cinder-volume[85682]: INFO cinder.volume.manager [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Determined volume DB was empty at startup. Jul 08 03:23:40 devstack cinder-volume[85682]: DEBUG cinder.volume.manager [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85682) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 03:23:40 devstack cinder-volume[85682]: INFO cinder.volume.manager [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 03:23:40 devstack cinder-volume[85682]: WARNING stevedore.named [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 03:23:40 devstack cinder-volume[85682]: WARNING castellan.key_manager [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:23:40 devstack cinder-volume[85682]: WARNING cinder.keymgr.conf_key_mgr [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:23:41 devstack cinder-volume[85682]: INFO cinder.volume.manager [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_db.sqlalchemy.engines [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:41 devstack cinder-volume[85682]: INFO oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Starting 1 workers Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Started child 85906 {{(pid=85682) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Full set of CONF: {{(pid=85682) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] ******************************************************************************** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Configuration options gathered from: {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] ================================================================================ {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 03:23:41 devstack cinder-volume[85906]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] allow_availability_zone_fallback = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] allow_compression_on_image_upload = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] allowed_direct_url_schemes = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] api_rate_limit = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] auth_strategy = keystone {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_availability_zone = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_host = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_stats_polling_interval = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backup_api_class = cinder.backup.api.API {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backup_name_template = backup-%s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backup_use_same_host = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backup_use_temp_snapshot = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] chap_password = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] chap_username = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_internal_tenant_project_id = 5ecf51ecd30e4f32834a6d0737643b42 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_internal_tenant_user_id = 4501c915262d4570a09b37db917d97c1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cluster = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] compression_format = gzip {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] compute_api_class = cinder.compute.nova.API {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] config_dir = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] config_source = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] control_exchange = openstack {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] debug = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] default_availability_zone = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] default_group_type = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] default_volume_type = QuobyteHD {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] disk_geometry = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] driver_client_cert = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] driver_client_cert_key = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] driver_data_namespace = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] driver_ssl_cert_path = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] driver_ssl_cert_verify = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] driver_use_ssl = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] enable_new_services = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] enable_unsupported_driver = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] enabled_backends = ['QuobyteHD'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] enforce_multipath_for_image_xfer = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] filter_function = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_api_insecure = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_api_ssl_compression = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_ca_certificates_file = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_catalog_info = image:glance:publicURL {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_num_retries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance_request_timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] goodness_function = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] graceful_shutdown_timeout = 5 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] group_api_class = cinder.group.api.API {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] host = devstack {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_compress_on_upload = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_conversion_address_space_limit = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_conversion_cpu_limit = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_conversion_disable = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_upload_use_cinder_backend = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_upload_use_internal_tenant = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_volume_cache_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_volume_cache_max_count = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] image_volume_cache_max_size_gb = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] init_host_max_objects_retrieval = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] instance_format = [instance: %(uuid)s] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] iscsi_target_flags = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] iscsi_write_cache = on {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] iser_helper = tgtadm {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] iser_ip_address = 192.168.122.200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] iser_port = 3260 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_color = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_config_append = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_dir = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_file = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_options = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_rotate_interval = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_rotate_interval_type = days {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] log_rotation_type = none {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] max_age = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] max_logfile_count = 30 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] max_logfile_size_mb = 200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] max_over_subscription_ratio = 20.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] message_reap_interval = 86400 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] message_ttl = 2592000 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] migration_create_volume_timeout_secs = 300 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] monkey_patch = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] monkey_patch_modules = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] my_ip = 192.168.122.200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] no_snapshot_gb_quota = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85906]: INFO cinder.volume.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] num_iser_scan_tries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.remotefs [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85906) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] num_shell_tries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] num_volume_device_scan_tries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] nvmeof_conn_info_version = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] nvmet_ns_id = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] nvmet_port_id = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_max_limit = 1000 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_volume_ext_list = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_volume_listen_port = 8776 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_volume_use_ssl = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] osapi_volume_workers = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] per_volume_size_limit = -1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] periodic_fuzzy_delay = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] periodic_interval = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] public_endpoint = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] publish_errors = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_backup_gigabytes = 1000 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_backups = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_gigabytes = 1000 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_groups = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_snapshots = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] quota_volumes = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] rate_limit_burst = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] rate_limit_except_level = CRITICAL {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] rate_limit_interval = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] reinit_driver_count = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] replication_device = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] report_discard_supported = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] report_interval = 120 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] reservation_clean_interval = 86400 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] reservation_expire = 86400 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] reserved_image_namespaces = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] reserved_percentage = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] rpc_response_timeout = 120 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] run_external_periodic_tasks = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] scst_target_driver = iscsi {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] scst_target_iqn_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_down_time = 720 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] shell_completion = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] snapshot_name_template = snapshot-%s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] split_loggers = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] state_path = /opt/stack/data/cinder {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] storage_availability_zone = nova {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] storage_protocol = iSCSI {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] syslog_log_facility = LOG_USER {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] target_helper = lioadm {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] target_ip_address = 192.168.122.200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] target_port = 3260 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] target_protocol = iscsi {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] target_secondary_ip_addresses = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] trace_flags = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] transport_url = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] until_refresh = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_chap_auth = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_default_quota_class = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_journal = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_json = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_multipath_for_image_xfer = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_stderr = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] use_syslog = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] verify_glance_signatures = enabled {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_api_class = cinder.volume.api.API {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_backend_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_clear = zero {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_clear_ionice = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_clear_size = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_copy_bps_limit = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_dd_blocksize = 1M {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_name_template = volume-%s {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_service_inithost_offload = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volume_usage_audit_period = month {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] zoning_mode = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_concurrency.disable_process_locking = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.auth_section = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.auth_type = password {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.auth_version = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.cache = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.include_service_catalog = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.insecure = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.interface = public {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_password = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcache_username = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.region_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.service_type = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.backend = dogpile.cache.null {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.backend_argument = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.backend_expiration_time = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.config_prefix = cache.oslo {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.debug_cache_backend = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.enable_retry_client = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.enable_socket_keepalive = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.expiration_time = 600 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.hashclient_retry_attempts = 2 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_dead_retry = 300 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_pool_maxsize = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85906) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 03:23:41 devstack cinder-volume[85906]: WARNING cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 03:23:41 devstack cinder-volume[85906]: WARNING cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Running cmd (subprocess): mount.quobyte {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_sasl_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.password = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.proxies = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.redis_db = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.redis_server = localhost:6379 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.retry_attempts = 2 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.retry_delay = 0.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.socket_keepalive_count = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.socket_keepalive_idle = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.socket_keepalive_interval = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.socket_timeout = 1.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.tls_allowed_ciphers = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.tls_cafile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.tls_certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.tls_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.tls_keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cache.username = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] coordination.backend_url = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.asyncio_connection = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.asyncio_slave_connection = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.backend = sqlalchemy {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.connection = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.connection_debug = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.connection_parameters = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.connection_recycle_time = 3600 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.connection_trace = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.db_inc_retry_interval = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.db_max_retries = 20 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.db_max_retry_interval = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.db_retry_interval = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.max_overflow = 50 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.max_pool_size = 5 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.max_retries = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.mysql_wsrep_sync_wait = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.pool_timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.retry_interval = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.slave_connection = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.sqlite_synchronous = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.synchronous_reader = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] database.use_db_reconnect = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.connection_string = messaging:// {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.es_doc_type = notification {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.es_scroll_size = 10000 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.es_scroll_time = 2m {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.filter_error_trace = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.hmac_keys = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.sentinel_service_name = mymaster {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.socket_timeout = 0.1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.trace_requests = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler.trace_sqlalchemy = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler_jaeger.process_tags = {} {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler_jaeger.service_name_prefix = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] profiler_otlp.service_name_prefix = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.enforce_new_defaults = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.enforce_scope = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.policy_default_rule = default {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.policy_file = policy.yaml {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.group = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.helper_command = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] privsep_osbrick.user = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.group = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.helper_command = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] cinder_sys_admin.user = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.auth_section = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.auth_type = password {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.cafile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.collect_timing = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.insecure = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.send_service_user_token = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.split_loggers = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] service_user.timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.auth_section = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.auth_type = password {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.collect_timing = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.insecure = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.region_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.split_loggers = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] glance.timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.backend_availability_zone = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.chap_password = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.chap_username = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.disk_geometry = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.driver_client_cert = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.driver_client_cert_key = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.driver_data_namespace = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.driver_use_ssl = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.extra_capabilities = {} {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.filter_function = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.goodness_function = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.iscsi_target_flags = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.iscsi_write_cache = on {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.iser_helper = tgtadm {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.iser_port = 3260 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_host = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_login = admin {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_mount_options = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_password = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_private_key = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_share_path = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.num_shell_tries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.quobyte_volume_url = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.replication_device = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.report_discard_supported = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.reserved_percentage = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.target_helper = tgtadm {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.target_port = 3260 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.target_protocol = iscsi {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.trace_flags = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.unique_fqdn_network = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.use_chap_auth = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_backend_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_clear = zero {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_clear_ionice = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_clear_size = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_reports.file_event_handler = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_reports.log_dir = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.backend_availability_zone = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.backend_host = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.chap_password = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.chap_username = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.chiscsi_conf = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.disk_geometry = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.driver_client_cert = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.driver_data_namespace = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.driver_use_ssl = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.extra_capabilities = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.filter_function = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.goodness_function = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.iser_helper = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.iser_ip_address = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.iser_port = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.iser_target_prefix = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_host = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_login = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_mount_options = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_password = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_private_key = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_share_path = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_ssh_port = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.num_shell_tries = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.nvmet_port_id = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.replication_device = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.report_discard_supported = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.reserved_percentage = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.scst_target_driver = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.storage_protocol = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.target_helper = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack quobyte-client[85907]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 03:23:41 devstack quobyte-client[85907]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.target_ip_address = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.target_port = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.target_prefix = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.target_protocol = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] CMD "mount.quobyte" returned: 1 in 0.139s {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.trace_flags = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.use_chap_auth = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_clear = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_clear_size = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=85906) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85906]: INFO cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df ... Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] QuobyteHD.volumes_dir = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb -c /etc/quobyte/client-cinder.cfg {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_notifications.driver = [] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_notifications.retry = -1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] key_manager.fixed_key = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.barbican_api_version = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.barbican_endpoint = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.barbican_endpoint_type = public {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.barbican_region_name = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.cafile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb -c /etc/quobyte/client-cinder.cfg Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.collect_timing = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.insecure = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.number_of_retries = 60 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.retry_delay = 1 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.send_service_user_token = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.split_loggers = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.verify_ssl = True {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican.verify_ssl_path = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.auth_section = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.auth_type = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.cafile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.certfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.collect_timing = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.insecure = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.keyfile = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.split_loggers = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] barbican_service_user.timeout = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.approle_role_id = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.approle_secret_id = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.kv_mountpoint = secret {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.kv_path = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.kv_version = 2 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.namespace = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.root_token_id = **** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.ssl_ca_crt_file = None {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.timeout = 60.0 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.use_ssl = False {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:41 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] ******************************************************************************** {{(pid=85682) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 03:23:42 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:42 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.794s {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:42 devstack cinder-volume[85906]: INFO cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df succeeded Jul 08 03:23:42 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=85906) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:23:42 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.830s {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:23:42 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:42 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:23:42 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:43 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.794s {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:43 devstack cinder-volume[85906]: INFO cinder.volume.driver [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG cinder.volume.driver [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85906) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG oslo_db.sqlalchemy.engines [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85906) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG dbcounter [-] [85906] Writer thread running {{(pid=85906) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG cinder.db.api [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Building query based on filter {{(pid=85906) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG cinder.image.image_utils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85906) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 03:23:43 devstack cinder-volume[85906]: INFO cinder.keymgr.migration [None req-4af8e414-d3ae-4047-9120-eeeba61377e8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=85906) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=85906) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:23:43 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:43 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:23:43 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:44 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.930s {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG cinder.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Notifying Schedulers of capabilities ... {{(pid=85906) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:23:44 devstack cinder-volume[85906]: INFO cinder.volume.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Driver initialization completed successfully. Jul 08 03:23:44 devstack cinder-volume[85906]: INFO cinder.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Initiating service 3 cleanup Jul 08 03:23:44 devstack cinder-volume[85906]: INFO cinder.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Service 3 cleanup completed. Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG cinder.service [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Creating RPC server for service cinder-volume {{(pid=85906) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG cinder.service [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85906) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 03:23:44 devstack cinder-volume[85906]: INFO cinder.volume.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=85906) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG cinder.volume.drivers.quobyte [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=85906) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85906) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:23:44 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:44 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:23:44 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:45 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:45 devstack cinder-volume[85906]: DEBUG oslo_concurrency.processutils [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.062s {{(pid=85906) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:45 devstack cinder-volume[85906]: INFO cinder.volume.manager [None req-3f48052c-3747-4be0-8b9d-1bcba7f707c1 None None] Driver post RPC initialization completed successfully. Jul 08 03:23:45 devstack cinder-volume[85682]: INFO oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Caught SIGTERM, stopping children Jul 08 03:23:45 devstack cinder-volume[85682]: DEBUG oslo_concurrency.lockutils [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Acquiring lock "singleton_lock" {{(pid=85682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:23:45 devstack cinder-volume[85682]: DEBUG oslo_concurrency.lockutils [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Acquired lock "singleton_lock" {{(pid=85682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:23:45 devstack cinder-volume[85682]: DEBUG oslo_concurrency.lockutils [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Releasing lock "singleton_lock" {{(pid=85682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:23:45 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Stop services. {{(pid=85682) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 03:23:45 devstack cinder-volume[85682]: DEBUG oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Killing children. {{(pid=85682) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 03:23:45 devstack cinder-volume[85682]: INFO oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Waiting on 1 children to exit Jul 08 03:23:46 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Acquiring lock "singleton_lock" {{(pid=85906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:23:46 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Acquired lock "singleton_lock" {{(pid=85906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:23:46 devstack cinder-volume[85906]: DEBUG oslo_concurrency.lockutils [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Releasing lock "singleton_lock" {{(pid=85906) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:23:46 devstack cinder-volume[85906]: WARNING amqp [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 03:23:46 devstack cinder-volume[85906]: WARNING amqp [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 03:23:46 devstack cinder-volume[85682]: INFO oslo_service.backend._eventlet.service [None req-56cba654-1cde-4f3b-8d6c-a6bd83b82779 None None] Child 85906 exited with status 0 Jul 08 03:23:47 devstack cinder-volume[86214]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 03:23:47 devstack cinder-volume[86214]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 03:23:47 devstack cinder-volume[86214]: we strongly recommend against using it for new projects. Jul 08 03:23:47 devstack cinder-volume[86214]: If you are already using Eventlet, we recommend migrating to a different Jul 08 03:23:47 devstack cinder-volume[86214]: framework. For more detail see Jul 08 03:23:47 devstack cinder-volume[86214]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 03:23:47 devstack cinder-volume[86214]: import eventlet # noqa Jul 08 03:23:49 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 03:23:49 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 03:23:49 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 03:23:50 devstack cinder-volume[86214]: INFO dbcounter [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Registered counter for database cinder Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG dbcounter [-] [86214] Writer thread running {{(pid=86214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 03:23:50 devstack cinder-volume[86214]: INFO cinder.rpc [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 03:23:50 devstack cinder-volume[86214]: INFO cinder.rpc [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:50 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Determined volume DB was empty at startup. Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG cinder.volume.manager [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86214) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 03:23:50 devstack cinder-volume[86214]: WARNING stevedore.named [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 03:23:50 devstack cinder-volume[86214]: WARNING castellan.key_manager [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:23:50 devstack cinder-volume[86214]: WARNING cinder.keymgr.conf_key_mgr [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 03:23:50 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:50 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Starting 1 workers Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Started child 86294 {{(pid=86214) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Full set of CONF: {{(pid=86214) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] Configuration options gathered from: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 03:23:50 devstack cinder-volume[86294]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] ================================================================================ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] allow_availability_zone_fallback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] allow_compression_on_image_upload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] allowed_direct_url_schemes = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] api_rate_limit = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] auth_strategy = keystone {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_stats_polling_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backup_api_class = cinder.backup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backup_name_template = backup-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backup_use_same_host = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] chap_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_internal_tenant_project_id = 5ecf51ecd30e4f32834a6d0737643b42 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_internal_tenant_user_id = 4501c915262d4570a09b37db917d97c1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cluster = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] compression_format = gzip {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] compute_api_class = cinder.compute.nova.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] config_dir = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] config_source = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] control_exchange = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] debug = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] default_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] default_group_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] default_volume_type = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] enable_new_services = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] enabled_backends = ['QuobyteHD'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_api_insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_api_ssl_compression = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_ca_certificates_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_catalog_info = image:glance:publicURL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_num_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance_request_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] graceful_shutdown_timeout = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] group_api_class = cinder.group.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] host = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_compress_on_upload = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_conversion_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_conversion_cpu_limit = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_conversion_disable = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] init_host_max_objects_retrieval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] instance_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] iscsi_target_flags = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] iser_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] iser_ip_address = 192.168.122.200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] iser_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_color = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_config_append = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_options = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_rotate_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_rotate_interval_type = days {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] log_rotation_type = none {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] max_age = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] max_logfile_count = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] max_logfile_size_mb = 200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] message_reap_interval = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] message_ttl = 2592000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] migration_create_volume_timeout_secs = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] monkey_patch = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] monkey_patch_modules = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] my_ip = 192.168.122.200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] no_snapshot_gb_quota = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86294) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] nvmet_ns_id = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_max_limit = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_volume_ext_list = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_volume_listen_port = 8776 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_volume_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] osapi_volume_workers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] per_volume_size_limit = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] periodic_fuzzy_delay = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] periodic_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] public_endpoint = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] publish_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_backup_gigabytes = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_backups = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_gigabytes = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_groups = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_snapshots = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] quota_volumes = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] rate_limit_burst = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] rate_limit_except_level = CRITICAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] rate_limit_interval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] reinit_driver_count = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] report_interval = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] reservation_clean_interval = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] reservation_expire = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] reserved_image_namespaces = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] rpc_response_timeout = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] run_external_periodic_tasks = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_down_time = 720 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] shell_completion = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] snapshot_name_template = snapshot-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] state_path = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] storage_availability_zone = nova {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] syslog_log_facility = LOG_USER {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] target_helper = lioadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] target_ip_address = 192.168.122.200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] target_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] until_refresh = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_default_quota_class = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_journal = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_json = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_stderr = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] use_syslog = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] verify_glance_signatures = enabled {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_api_class = cinder.volume.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_clear = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_name_template = volume-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_service_inithost_offload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volume_usage_audit_period = month {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] zoning_mode = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_concurrency.disable_process_locking = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.auth_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.include_service_catalog = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.interface = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_password = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcache_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.service_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.backend = dogpile.cache.null {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.backend_argument = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.backend_expiration_time = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.config_prefix = cache.oslo {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.debug_cache_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.enable_retry_client = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.enable_socket_keepalive = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.expiration_time = 600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.hashclient_retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.proxies = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.redis_db = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.redis_server = localhost:6379 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.retry_delay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.socket_keepalive_count = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.socket_keepalive_idle = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.socket_keepalive_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.socket_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cache.username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] coordination.backend_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.asyncio_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.asyncio_slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.backend = sqlalchemy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.connection_debug = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.connection_parameters = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.connection_recycle_time = 3600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.connection_trace = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.db_inc_retry_interval = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.db_max_retries = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.db_max_retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.db_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.max_overflow = 50 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.max_pool_size = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.max_retries = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.mysql_wsrep_sync_wait = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.pool_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.sqlite_synchronous = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.synchronous_reader = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] database.use_db_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86294) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 03:23:50 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.connection_string = messaging:// {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.es_doc_type = notification {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.es_scroll_size = 10000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.es_scroll_time = 2m {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Running cmd (subprocess): mount.quobyte {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.filter_error_trace = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.hmac_keys = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.socket_timeout = 0.1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.trace_requests = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler.trace_sqlalchemy = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler_jaeger.process_tags = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler_jaeger.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] profiler_otlp.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.enforce_new_defaults = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.enforce_scope = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.policy_default_rule = default {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.policy_file = policy.yaml {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.group = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] privsep_osbrick.user = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.group = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] cinder_sys_admin.user = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.send_service_user_token = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] service_user.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] glance.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.chap_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.extra_capabilities = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.iscsi_target_flags = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.iser_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.iser_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_host = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_login = admin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_private_key = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_share_path = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.quobyte_volume_url = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.target_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.target_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.unique_fqdn_network = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_clear = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_reports.file_event_handler = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_reports.log_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.backend_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.chap_username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.chiscsi_conf = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.driver_use_ssl = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.extra_capabilities = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.iser_helper = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.iser_ip_address = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.iser_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.iser_target_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_login = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_private_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_share_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_ssh_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.num_shell_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.nvmet_port_id = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.report_discard_supported = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.reserved_percentage = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.scst_target_driver = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.storage_protocol = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.target_helper = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.target_ip_address = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.target_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.target_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.target_protocol = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.use_chap_auth = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_clear = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_clear_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] QuobyteHD.volumes_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_notifications.driver = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_notifications.retry = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] key_manager.fixed_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.barbican_api_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.barbican_endpoint = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.barbican_endpoint_type = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.barbican_region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.number_of_retries = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.retry_delay = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.send_service_user_token = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.verify_ssl = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican.verify_ssl_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.auth_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] barbican_service_user.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.approle_role_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.approle_secret_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.kv_mountpoint = secret {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.kv_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.kv_version = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.root_token_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 03:23:50 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-67bdfc5f-60c1-4ec8-a749-516ce98576eb None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 03:23:50 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:23:50 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:51 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.617s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:51 devstack cinder-volume[86294]: INFO cinder.volume.driver [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG cinder.volume.driver [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86294) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG oslo_db.sqlalchemy.engines [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86294) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writer thread running {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG cinder.db.api [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Building query based on filter {{(pid=86294) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86294) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:23:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:51 devstack cinder-volume[86294]: INFO cinder.keymgr.migration [None req-a50906e4-f5c3-46eb-a667-c57e639e3e4b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 03:23:51 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:23:51 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:52 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.610s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:23:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Driver initialization completed successfully. Jul 08 03:23:52 devstack cinder-volume[86294]: INFO cinder.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Initiating service 3 cleanup Jul 08 03:23:52 devstack cinder-volume[86294]: INFO cinder.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Service 3 cleanup completed. Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG cinder.service [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Creating RPC server for service cinder-volume {{(pid=86294) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG cinder.service [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86294) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 03:23:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:23:52 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:23:52 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:23:52 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Jul 08 03:23:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:23:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-375efd72-e9fa-4831-a93d-9dc4f98d7159 None None] Driver post RPC initialization completed successfully. Jul 08 03:24:00 devstack cinder-volume[86214]: DEBUG dbcounter [-] [86214] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:24:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:24:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:24:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:24:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 6 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:24:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:25:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:25:46 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:25:46 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:25:47 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Jul 08 03:25:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:25:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:25:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:25:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 6 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:25:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:26:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:26:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:26:21 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Flow 'volume_create_manager' (3fef4e22-4ca4-4abc-bd73-3546407098b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c644ed-e7c9-489c-9ea8-14fa6773cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c644ed-e7c9-489c-9ea8-14fa6773cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1882921168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f641b52-be11-4340-93ed-0583667578c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03361950b3134ab7ba7cbafd705b5140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:26:22Z,use_quota=True,user_id='06a3791f2c0843189baf1967c18d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcb2a49-2904-4c40-a715-9e302b78fbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcb2a49-2904-4c40-a715-9e302b78fbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6132a3e-942f-498b-8782-5d1c58b507b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6132a3e-942f-498b-8782-5d1c58b507b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f641b52-be11-4340-93ed-0583667578c4', 'volume_name': 'volume-1f641b52-be11-4340-93ed-0583667578c4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910f39c0-1a22-4cb4-8106-2aa104742b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910f39c0-1a22-4cb4-8106-2aa104742b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b000b6d6-77ca-498f-8acf-ecd5d70cecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Volume 1f641b52-be11-4340-93ed-0583667578c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f641b52-be11-4340-93ed-0583667578c4', 'volume_size': 1} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1882921168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f641b52-be11-4340-93ed-0583667578c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03361950b3134ab7ba7cbafd705b5140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:26:22Z,use_quota=True,user_id='06a3791f2c0843189baf1967c18d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Creating volume 1f641b52-be11-4340-93ed-0583667578c4 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:26:22 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:26:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:22 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 1073741824 Jul 08 03:26:22 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:24 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 1073741824" returned: 0 in 1.942s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:24 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 Jul 08 03:26:24 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:25 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4" returned: 0 in 1.151s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] <== create_volume: return (3340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.342s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b000b6d6-77ca-498f-8acf-ecd5d70cecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f641b52-be11-4340-93ed-0583667578c4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5317a3d6-a4ec-4b97-a914-3f2c46d413f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Volume volume-1f641b52-be11-4340-93ed-0583667578c4 (1f641b52-be11-4340-93ed-0583667578c4): created successfully Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5317a3d6-a4ec-4b97-a914-3f2c46d413f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Flow 'volume_create_manager' (3fef4e22-4ca4-4abc-bd73-3546407098b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:26:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-972820bf-2ad6-41b9-b8f7-e901b924ddbb tempest-DeleteServersTestJSON-386194753 None] Created volume successfully. Jul 08 03:26:32 devstack cinder-volume[86294]: WARNING py.warnings [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 08 03:26:32 devstack cinder-volume[86294]: .first() Jul 08 03:26:32 devstack cinder-volume[86294]: Jul 08 03:26:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:32 devstack cinder-volume[86294]: INFO oslo.privsep.daemon [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9g0zzlgc/privsep.sock'] Jul 08 03:26:32 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9g0zzlgc/privsep.sock Jul 08 03:26:32 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 03:26:33 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 03:26:34 devstack cinder-volume[86294]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 03:26:34 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:34 devstack cinder-volume[86294]: INFO oslo.privsep.daemon [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Spawned new privsep daemon via rootwrap Jul 08 03:26:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Accepted privsep connection to /tmp/tmp9g0zzlgc/privsep.sock {{(pid=86294) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 03:26:34 devstack cinder-volume[86294]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 03:26:34 devstack cinder-volume[86294]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 03:26:34 devstack cinder-volume[86294]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 03:26:34 devstack cinder-volume[86294]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88194 Jul 08 03:26:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c03958-6833-4824-82af-9d1f804dd0da]: (2,) {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:26:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc39f4-2e41-468a-90ff-ced35044fb54]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:26:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:34 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 Jul 08 03:26:34 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:35 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4" returned: 0 in 0.903s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.983s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-1f641b52-be11-4340-93ed-0583667578c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afbf9e49-804c-4aee-b790-895c5a34f5ab', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:26:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-d3d42855-1fb3-47e0-8b58-b1a94bf652f0 req-c899847f-b3ca-475d-aacb-60374aca1f3b tempest-DeleteServersTestJSON-386194753 None] attachment_update completed successfully. Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Flow 'volume_create_manager' (c0d283c7-3219-452d-9bcc-7652e40595c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03000dfa-4cdb-4cf2-a18d-a2675b67bfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03000dfa-4cdb-4cf2-a18d-a2675b67bfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-668863316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f68191a-0e8a-425a-a117-30ecaf493cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffa18b9a6184d5f88b75d93dc3528e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:26:40Z,use_quota=True,user_id='484c8f46cc6344bab67f1d85a96e0328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7424cf-74dc-41d9-bc6b-f141ee06897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7424cf-74dc-41d9-bc6b-f141ee06897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c876d1-1c4f-4777-89a0-0eacb2e5447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c876d1-1c4f-4777-89a0-0eacb2e5447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f68191a-0e8a-425a-a117-30ecaf493cdc', 'volume_name': 'volume-9f68191a-0e8a-425a-a117-30ecaf493cdc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b327c2-e1f9-4e57-a6fd-86dc8c11cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b327c2-e1f9-4e57-a6fd-86dc8c11cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc8339f-d79b-4588-bbab-32a577a74fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Volume 9f68191a-0e8a-425a-a117-30ecaf493cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f68191a-0e8a-425a-a117-30ecaf493cdc', 'volume_size': 1} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-668863316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f68191a-0e8a-425a-a117-30ecaf493cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffa18b9a6184d5f88b75d93dc3528e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:26:40Z,use_quota=True,user_id='484c8f46cc6344bab67f1d85a96e0328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Creating volume 9f68191a-0e8a-425a-a117-30ecaf493cdc {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:26:40 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:26:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:40 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc 1073741824 Jul 08 03:26:40 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:42 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc 1073741824" returned: 0 in 2.451s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:43 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc Jul 08 03:26:43 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:43 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc" returned: 0 in 0.965s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] <== create_volume: return (3541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:26:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.544s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc8339f-d79b-4588-bbab-32a577a74fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f68191a-0e8a-425a-a117-30ecaf493cdc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7432bb8-4e30-4264-9185-74a5969e948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:26:44 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Volume volume-9f68191a-0e8a-425a-a117-30ecaf493cdc (9f68191a-0e8a-425a-a117-30ecaf493cdc): created successfully Jul 08 03:26:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7432bb8-4e30-4264-9185-74a5969e948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:26:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Flow 'volume_create_manager' (c0d283c7-3219-452d-9bcc-7652e40595c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:26:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a1ba6ffb-d4f0-4996-bac7-12868c25bf98 tempest-VolumesAdminNegativeTest-708140284 None] Created volume successfully. Jul 08 03:26:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Acquiring lock "cinder-9f68191a-0e8a-425a-a117-30ecaf493cdc-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:26:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Lock "cinder-9f68191a-0e8a-425a-a117-30ecaf493cdc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:26:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Acquiring lock "cinder-quobyte-9f68191a-0e8a-425a-a117-30ecaf493cdc" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:26:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Lock "cinder-quobyte-9f68191a-0e8a-425a-a117-30ecaf493cdc" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:26:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf956d2-5837-4a58-9b72-e26427a3c40e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:26:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:45 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc Jul 08 03:26:45 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:46 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc" returned: 0 in 1.209s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:46 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc Jul 08 03:26:46 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:47 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:26:47 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:49 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 2.104s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 8 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:26:49 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9f68191a-0e8a-425a-a117-30ecaf493cdc" returned: 0 in 2.403s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Lock "cinder-quobyte-9f68191a-0e8a-425a-a117-30ecaf493cdc" released by "delete_volume" :: held 3.709s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:26:49 devstack cinder-volume[86294]: WARNING cinder.quota [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:26:49 devstack cinder-volume[86294]: WARNING cinder.quota [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Created reservations ['8376b010-5865-4ea8-bc9d-810ca045edfa', 'c985cab4-c1d8-411f-8598-06e6071bb6e5', 'b6248015-e3d7-4d96-a118-e49a60f46f0a', '0e38f2bc-5ca5-46ba-9e98-9b29dfb02cb6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:49 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:26:49 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-030a1f35-9bff-4821-9b93-7f4165914f58 req-f44a7772-21d8-4343-b209-67aa1a0aa0d4 tempest-DeleteServersTestJSON-386194753 None] Terminate volume connection completed successfully. Jul 08 03:26:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-030a1f35-9bff-4821-9b93-7f4165914f58 req-f44a7772-21d8-4343-b209-67aa1a0aa0d4 tempest-DeleteServersTestJSON-386194753 None] Deleting attachment afbf9e49-804c-4aee-b790-895c5a34f5ab. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:26:51 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.347s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:51 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:26:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Deleted volume successfully. Jul 08 03:26:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38ae3449-7f00-4370-80bd-bcba3dcae9bf tempest-VolumesAdminNegativeTest-708140284 None] Lock "cinder-9f68191a-0e8a-425a-a117-30ecaf493cdc-delete_volume" released by "delete_volume" :: held 5.800s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:26:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Acquiring lock "cinder-1f641b52-be11-4340-93ed-0583667578c4-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:26:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Lock "cinder-1f641b52-be11-4340-93ed-0583667578c4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:26:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Acquiring lock "cinder-quobyte-1f641b52-be11-4340-93ed-0583667578c4" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:26:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Lock "cinder-quobyte-1f641b52-be11-4340-93ed-0583667578c4" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:26:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cdc8b3-2e65-4d2d-b337-19169b43a072]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:26:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:56 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 Jul 08 03:26:56 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:57 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4" returned: 0 in 1.106s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:57 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4 Jul 08 03:26:57 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:58 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1f641b52-be11-4340-93ed-0583667578c4" returned: 0 in 0.781s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Lock "cinder-quobyte-1f641b52-be11-4340-93ed-0583667578c4" released by "delete_volume" :: held 1.952s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Created reservations ['bfe65739-5860-44a9-b23d-4f6ae28a30e4', 'b9a5de86-b003-44d6-9007-62bec4a3d5ad', 'a7ccc9e7-8065-4258-82ad-d2d1d16157b3', '19393349-8729-49a7-8364-93d657234524'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:26:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:26:58 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:26:58 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:26:59 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Jul 08 03:26:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:26:59 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:26:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Deleted volume successfully. Jul 08 03:26:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b933c9e-4af2-4011-98d4-d13a5d04b36d tempest-DeleteServersTestJSON-386194753 None] Lock "cinder-1f641b52-be11-4340-93ed-0583667578c4-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:27:08 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:27:09 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=23,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Flow 'volume_create_manager' (7df1bb5e-af76-4825-840c-f3a8245c5ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803e9f62-eac2-454f-ba6e-38ebb9e5c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803e9f62-eac2-454f-ba6e-38ebb9e5c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-41498488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45011dc-554c-4efc-96f8-38a3c5341ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc275e4404944f687e1ed2159bb5615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:20Z,use_quota=True,user_id='af98850137cd44199188e030252b0e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fb3b0d-8df2-4b94-9898-bfd14395a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fb3b0d-8df2-4b94-9898-bfd14395a14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7a1e2c-5f1a-4dc7-b155-a323a41af974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7a1e2c-5f1a-4dc7-b155-a323a41af974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45011dc-554c-4efc-96f8-38a3c5341ce4', 'volume_name': 'volume-a45011dc-554c-4efc-96f8-38a3c5341ce4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aae580e-6295-4527-b4a9-306dd7247b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aae580e-6295-4527-b4a9-306dd7247b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155358ea-d4b7-4be3-a0d4-054e2dc11a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:19 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Volume a45011dc-554c-4efc-96f8-38a3c5341ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45011dc-554c-4efc-96f8-38a3c5341ce4', 'volume_size': 1} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-41498488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45011dc-554c-4efc-96f8-38a3c5341ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc275e4404944f687e1ed2159bb5615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:20Z,use_quota=True,user_id='af98850137cd44199188e030252b0e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Creating volume a45011dc-554c-4efc-96f8-38a3c5341ce4 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:27:19 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:27:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:19 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 1073741824 Jul 08 03:27:19 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:21 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 1073741824" returned: 0 in 1.296s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:21 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 Jul 08 03:27:21 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:22 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4" returned: 0 in 0.846s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155358ea-d4b7-4be3-a0d4-054e2dc11a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45011dc-554c-4efc-96f8-38a3c5341ce4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680a1a8c-b537-4aba-9cf6-a6a996eee0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Volume volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 (a45011dc-554c-4efc-96f8-38a3c5341ce4): created successfully Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680a1a8c-b537-4aba-9cf6-a6a996eee0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Flow 'volume_create_manager' (7df1bb5e-af76-4825-840c-f3a8245c5ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-876d5407-5b3d-4725-98dd-ede3a93b6cf6 tempest-ServersNegativeTestJSON-907270342 None] Created volume successfully. Jul 08 03:27:24 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:27:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Flow 'volume_create_manager' (668c7c8a-25f4-4401-aaf8-0d54e9ef1edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2201a701-8f26-4c9c-87e4-2c525a7a8000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2201a701-8f26-4c9c-87e4-2c525a7a8000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1706573181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb780b63-13ac-403f-947d-b19ef59b6751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc275e4404944f687e1ed2159bb5615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:25Z,use_quota=True,user_id='af98850137cd44199188e030252b0e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aba681-3d85-477d-b4a0-2ecc951bbd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aba681-3d85-477d-b4a0-2ecc951bbd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17811b47-6ec3-43f3-9455-4a673394b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17811b47-6ec3-43f3-9455-4a673394b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb780b63-13ac-403f-947d-b19ef59b6751', 'volume_name': 'volume-fb780b63-13ac-403f-947d-b19ef59b6751', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d479e632-a465-4be3-b1d6-bb5d8cdc7364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d479e632-a465-4be3-b1d6-bb5d8cdc7364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2ca7c4-ad33-4764-b3a3-5ea26f5e21c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Volume fb780b63-13ac-403f-947d-b19ef59b6751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb780b63-13ac-403f-947d-b19ef59b6751', 'volume_size': 1} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1706573181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb780b63-13ac-403f-947d-b19ef59b6751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc275e4404944f687e1ed2159bb5615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:25Z,use_quota=True,user_id='af98850137cd44199188e030252b0e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Creating volume fb780b63-13ac-403f-947d-b19ef59b6751 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:27:25 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:27:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:25 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 1073741824 Jul 08 03:27:25 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:26 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 1073741824" returned: 0 in 1.036s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:26 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 Jul 08 03:27:26 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:26 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751" returned: 0 in 0.768s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:27:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2ca7c4-ad33-4764-b3a3-5ea26f5e21c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb780b63-13ac-403f-947d-b19ef59b6751', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e1f661-b5e6-430f-8518-97f2d0d37f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Volume volume-fb780b63-13ac-403f-947d-b19ef59b6751 (fb780b63-13ac-403f-947d-b19ef59b6751): created successfully Jul 08 03:27:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e1f661-b5e6-430f-8518-97f2d0d37f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Flow 'volume_create_manager' (668c7c8a-25f4-4401-aaf8-0d54e9ef1edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0632c391-1f2c-44b8-95c2-79ed2ef162da tempest-ServersNegativeTestJSON-907270342 None] Created volume successfully. Jul 08 03:27:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "cinder-fb780b63-13ac-403f-947d-b19ef59b6751-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:27:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-fb780b63-13ac-403f-947d-b19ef59b6751-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:27:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "cinder-quobyte-fb780b63-13ac-403f-947d-b19ef59b6751" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:27:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-quobyte-fb780b63-13ac-403f-947d-b19ef59b6751" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:27:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[918526c6-05fa-47f9-aca6-0691d081ccd9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:27:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:31 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 Jul 08 03:27:31 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:32 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751" returned: 0 in 1.300s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:32 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751 Jul 08 03:27:32 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:33 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb780b63-13ac-403f-947d-b19ef59b6751" returned: 0 in 1.078s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-quobyte-fb780b63-13ac-403f-947d-b19ef59b6751" released by "delete_volume" :: held 2.470s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Created reservations ['80268834-3148-48d3-8696-956999478bac', '0c40b7d3-6342-4b97-b2dc-6872ab5973d1', '6f29b32f-9f9c-4d7b-b920-7d7adf6bf881', '06fec99e-8a56-49d1-90f2-fed21e0997aa'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:33 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:27:33 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "cinder-a45011dc-554c-4efc-96f8-38a3c5341ce4-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-a45011dc-554c-4efc-96f8-38a3c5341ce4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "cinder-quobyte-a45011dc-554c-4efc-96f8-38a3c5341ce4" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-quobyte-a45011dc-554c-4efc-96f8-38a3c5341ce4" acquired by "delete_volume" :: waited 0.045s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c2e03-beaf-453f-acce-e670d000ca6a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:34 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.283s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:27:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Deleted volume successfully. Jul 08 03:27:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ce29903d-afc5-46d4-bf39-2f913803e388 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-fb780b63-13ac-403f-947d-b19ef59b6751-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:27:34 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 Jul 08 03:27:34 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:35 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4" returned: 0 in 1.136s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:35 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4 Jul 08 03:27:35 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:36 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a45011dc-554c-4efc-96f8-38a3c5341ce4" returned: 0 in 1.011s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-quobyte-a45011dc-554c-4efc-96f8-38a3c5341ce4" released by "delete_volume" :: held 2.233s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Created reservations ['62a31ebd-d60a-4f52-8426-f06b6d39af38', 'eb9f9cc1-9173-48ef-806c-3ccb8d38df29', 'afd3b2f3-d85a-4c47-b3e5-20702de296dc', '429b39ea-a2d1-4662-8e96-171714c356ff'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:37 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:27:37 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:38 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.071s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:38 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:27:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Deleted volume successfully. Jul 08 03:27:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5c4a030a-c1e4-47bc-85ba-8102c45cfd94 tempest-ServersNegativeTestJSON-907270342 None] Lock "cinder-a45011dc-554c-4efc-96f8-38a3c5341ce4-delete_volume" released by "delete_volume" :: held 3.815s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Flow 'volume_create_manager' (6cfb469e-7b72-4633-987c-e94fb11228bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d037b5d-bb2f-459b-a3e1-2c7a2c9fe7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d037b5d-bb2f-459b-a3e1-2c7a2c9fe7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-627858972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7891472-3595-435c-a8fd-3f6be422a77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726ff70879ea488d855bdf0e742a5039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:40Z,use_quota=True,user_id='035f8fc9d99a4534aae46c64c1b2169f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8275fe5b-1ba8-4732-ae6b-7f7411cc085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8275fe5b-1ba8-4732-ae6b-7f7411cc085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9185445a-1e36-424c-acef-c65d674c7ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9185445a-1e36-424c-acef-c65d674c7ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7891472-3595-435c-a8fd-3f6be422a77d', 'volume_name': 'volume-b7891472-3595-435c-a8fd-3f6be422a77d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5410e3-8965-4286-bbf4-895ecf15cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5410e3-8965-4286-bbf4-895ecf15cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92be5179-d3c2-4342-a4cf-e11e53cd05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Volume b7891472-3595-435c-a8fd-3f6be422a77d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7891472-3595-435c-a8fd-3f6be422a77d', 'volume_size': 1} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-627858972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7891472-3595-435c-a8fd-3f6be422a77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726ff70879ea488d855bdf0e742a5039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:40Z,use_quota=True,user_id='035f8fc9d99a4534aae46c64c1b2169f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Creating volume b7891472-3595-435c-a8fd-3f6be422a77d {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:27:40 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:27:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:40 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d 1073741824 Jul 08 03:27:40 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:41 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d 1073741824" returned: 0 in 1.484s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:41 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d Jul 08 03:27:41 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:42 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d" returned: 0 in 0.993s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] <== create_volume: return (2561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:27:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.567s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92be5179-d3c2-4342-a4cf-e11e53cd05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7891472-3595-435c-a8fd-3f6be422a77d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b771ab-f9b8-4598-bf72-9eb7b6c7795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:42 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Volume volume-b7891472-3595-435c-a8fd-3f6be422a77d (b7891472-3595-435c-a8fd-3f6be422a77d): created successfully Jul 08 03:27:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b771ab-f9b8-4598-bf72-9eb7b6c7795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Flow 'volume_create_manager' (6cfb469e-7b72-4633-987c-e94fb11228bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-54b4a4d0-b74a-45ac-ab22-62fb4cc3286a tempest-TaggedAttachmentsTest-1779520448 None] Created volume successfully. Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:46 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:27:47 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:47 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Flow 'volume_create_manager' (0bf1327e-2076-401b-bb48-1db9a2e376a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4755e-f1c3-4923-b967-8b84409f3dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4755e-f1c3-4923-b967-8b84409f3dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1004279018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc52968f-0673-4320-8688-1846a696752d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334e622e1d1b4ce6a28e5e0dd37b6ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:53Z,use_quota=True,user_id='624f5d0fbbe442da94c47eb2004e927d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f99a3c7-56f5-4f20-bff7-bc2b9a9033ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f99a3c7-56f5-4f20-bff7-bc2b9a9033ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d517d71-72ca-44dd-8a6a-cd19afb9787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d517d71-72ca-44dd-8a6a-cd19afb9787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc52968f-0673-4320-8688-1846a696752d', 'volume_name': 'volume-fc52968f-0673-4320-8688-1846a696752d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2591a46-65dd-45cd-971b-21d321a06df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2591a46-65dd-45cd-971b-21d321a06df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf673ac-7c84-482b-acfc-24fd301dd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Volume fc52968f-0673-4320-8688-1846a696752d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc52968f-0673-4320-8688-1846a696752d', 'volume_size': 1} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1004279018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc52968f-0673-4320-8688-1846a696752d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334e622e1d1b4ce6a28e5e0dd37b6ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:53Z,use_quota=True,user_id='624f5d0fbbe442da94c47eb2004e927d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Creating volume fc52968f-0673-4320-8688-1846a696752d {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:27:53 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:27:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:53 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d 1073741824 Jul 08 03:27:53 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:54 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d 1073741824" returned: 0 in 1.429s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:54 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d Jul 08 03:27:54 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:27:55 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d" returned: 0 in 0.875s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] <== create_volume: return (2383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.387s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf673ac-7c84-482b-acfc-24fd301dd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc52968f-0673-4320-8688-1846a696752d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa2b8b-c9dc-4717-b06f-e2a882de4e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:55 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Volume volume-fc52968f-0673-4320-8688-1846a696752d (fc52968f-0673-4320-8688-1846a696752d): created successfully Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa2b8b-c9dc-4717-b06f-e2a882de4e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Flow 'volume_create_manager' (0bf1327e-2076-401b-bb48-1db9a2e376a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-10a32364-cbc7-4c27-a833-42bde4f85b7d tempest-ServerActionsTestOtherA-11905986 None] Created volume successfully. Jul 08 03:27:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-378793dc-580d-43f4-9b57-86311fa9ee0f tempest-GroupsTest-1960926890 None] Group tempest-Group1-990199772: creating Jul 08 03:27:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-378793dc-580d-43f4-9b57-86311fa9ee0f tempest-GroupsTest-1960926890 None] Group tempest-Group1-990199772: created successfully Jul 08 03:27:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-378793dc-580d-43f4-9b57-86311fa9ee0f tempest-GroupsTest-1960926890 None] Create group completed successfully. Jul 08 03:27:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-42f930dd-06b5-4063-8c8a-54d3c54e7eaf tempest-GroupsTest-1960926890 None] Group tempest-Group2-1289742537: creating Jul 08 03:27:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-42f930dd-06b5-4063-8c8a-54d3c54e7eaf tempest-GroupsTest-1960926890 None] Group tempest-Group2-1289742537: created successfully Jul 08 03:27:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-42f930dd-06b5-4063-8c8a-54d3c54e7eaf tempest-GroupsTest-1960926890 None] Create group completed successfully. Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Flow 'volume_create_manager' (7b197504-3b79-4ab7-9fc8-f5714d666aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2803d454-60ac-43b7-b02a-8b76169580b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2803d454-60ac-43b7-b02a-8b76169580b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-281779615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8d787cf-4b34-4000-99ed-9f0efc67b820,host='devstack@QuobyteHD#QuobyteHD',id=376887bb-847e-4ae0-ace6-91fc63f3747d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49f3cb1d10a44cd94588bd6a166f9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:59Z,use_quota=True,user_id='cf27d8284c04416ba24de6e80433521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f68c02e-0e95-43d1-bb0d-308287a3d6ef),volume_type_id=5f68c02e-0e95-43d1-bb0d-308287a3d6ef)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e93098-e312-4406-8093-026b43b76ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e93098-e312-4406-8093-026b43b76ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f4bdeb-f9c6-4e40-b77c-90ab0193756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f4bdeb-f9c6-4e40-b77c-90ab0193756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376887bb-847e-4ae0-ace6-91fc63f3747d', 'volume_name': 'volume-376887bb-847e-4ae0-ace6-91fc63f3747d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e10d7de-2dc1-4802-9d5f-62a13469b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e10d7de-2dc1-4802-9d5f-62a13469b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc432a3-fd80-4129-9336-3058c0463418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:27:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Volume 376887bb-847e-4ae0-ace6-91fc63f3747d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376887bb-847e-4ae0-ace6-91fc63f3747d', 'volume_size': 1} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8d787cf-4b34-4000-99ed-9f0efc67b820,created_at=2026-07-08T01:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-281779615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8d787cf-4b34-4000-99ed-9f0efc67b820,host='devstack@QuobyteHD#QuobyteHD',id=376887bb-847e-4ae0-ace6-91fc63f3747d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49f3cb1d10a44cd94588bd6a166f9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:27:59Z,use_quota=True,user_id='cf27d8284c04416ba24de6e80433521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f68c02e-0e95-43d1-bb0d-308287a3d6ef),volume_type_id=5f68c02e-0e95-43d1-bb0d-308287a3d6ef)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Creating volume 376887bb-847e-4ae0-ace6-91fc63f3747d {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:27:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:27:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:27:59 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d 1073741824 Jul 08 03:27:59 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:00 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d 1073741824" returned: 0 in 1.270s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:00 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d Jul 08 03:28:00 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:01 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d" returned: 0 in 0.794s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc432a3-fd80-4129-9336-3058c0463418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376887bb-847e-4ae0-ace6-91fc63f3747d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cdfb81-4b8e-4b0c-b19e-7e632f4bfd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Volume volume-376887bb-847e-4ae0-ace6-91fc63f3747d (376887bb-847e-4ae0-ace6-91fc63f3747d): created successfully Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cdfb81-4b8e-4b0c-b19e-7e632f4bfd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Flow 'volume_create_manager' (7b197504-3b79-4ab7-9fc8-f5714d666aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8704cffc-41b1-4bdd-a9df-926d045780de tempest-GroupsTest-1960926890 None] Created volume successfully. Jul 08 03:28:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Acquiring lock "cinder-quobyte-376887bb-847e-4ae0-ace6-91fc63f3747d" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:28:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Lock "cinder-quobyte-376887bb-847e-4ae0-ace6-91fc63f3747d" acquired by "delete_volume" :: waited 0.045s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:28:04 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[947cd5d6-5982-4d51-9ac2-e6bc28e78de5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:04 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d Jul 08 03:28:04 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:06 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d" returned: 0 in 2.288s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:06 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d Jul 08 03:28:06 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:07 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-376887bb-847e-4ae0-ace6-91fc63f3747d" returned: 0 in 1.009s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Lock "cinder-quobyte-376887bb-847e-4ae0-ace6-91fc63f3747d" released by "delete_volume" :: held 3.395s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:28:07 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Created reservations ['e3ad5790-5602-4195-bc1a-62ce0539c71a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:07 devstack cinder-volume[86294]: WARNING cinder.quota [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1171510302 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1171510302, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:28:07 devstack cinder-volume[86294]: WARNING cinder.quota [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1171510302 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1171510302, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:28:07 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Created reservations ['b6f9fba1-c41e-4780-ad28-fa7f8c239270', '8b198752-a189-425f-902f-675ecd11b781', 'd8c24de8-07ec-47e6-a1f2-9158d388c1d1', '5b60826b-6ab7-4b17-bdcd-c7ecbda775b7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:08 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:28:08 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:08 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Created reservations ['5c5ce27c-e21e-4dae-a165-3af5a7e60350'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:09 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:28:09 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:09 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.429s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:09 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:28:09 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e653e24c-f72d-49fb-89fd-08bd3fe92663 tempest-GroupsTest-1960926890 None] Delete group completed successfully. Jul 08 03:28:10 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.646s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:10 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:28:10 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-839f5447-1b2c-491f-901a-ca034f71fb59 tempest-GroupsTest-1960926890 None] Delete group completed successfully. Jul 08 03:28:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5456aa89-e927-4e53-9336-2ef52a297fd9 tempest-GroupsTest-1960926890 None] Group tempest-GroupsTest-Group-1788497280: creating Jul 08 03:28:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5456aa89-e927-4e53-9336-2ef52a297fd9 tempest-GroupsTest-1960926890 None] Group tempest-GroupsTest-Group-1788497280: created successfully Jul 08 03:28:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5456aa89-e927-4e53-9336-2ef52a297fd9 tempest-GroupsTest-1960926890 None] Create group completed successfully. Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Flow 'volume_create_manager' (cfef4bf5-24d8-49dd-b295-a617bd915a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4963699d-e6f9-4c30-9f27-eacdd232fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4963699d-e6f9-4c30-9f27-eacdd232fd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-824267265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5cc3a66-e7dd-4bd2-acc7-6e1e4e139dc8,host='devstack@QuobyteHD#QuobyteHD',id=f4a18d67-0b7f-4d80-a106-41a848891329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49f3cb1d10a44cd94588bd6a166f9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:13Z,use_quota=True,user_id='cf27d8284c04416ba24de6e80433521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22c3eb33-6713-441d-8998-a261502f58c2),volume_type_id=22c3eb33-6713-441d-8998-a261502f58c2)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc92d39-f12c-45f0-af26-0c7af39695d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc92d39-f12c-45f0-af26-0c7af39695d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89d67a8-19ed-40a5-93ce-4fb1eafc360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89d67a8-19ed-40a5-93ce-4fb1eafc360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a18d67-0b7f-4d80-a106-41a848891329', 'volume_name': 'volume-f4a18d67-0b7f-4d80-a106-41a848891329', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f051f5-5db7-430f-9aec-6acc3a8a7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f051f5-5db7-430f-9aec-6acc3a8a7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c375fe-5f68-4211-ad3d-5688f67123a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:13 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Volume f4a18d67-0b7f-4d80-a106-41a848891329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a18d67-0b7f-4d80-a106-41a848891329', 'volume_size': 1} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5cc3a66-e7dd-4bd2-acc7-6e1e4e139dc8,created_at=2026-07-08T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-824267265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5cc3a66-e7dd-4bd2-acc7-6e1e4e139dc8,host='devstack@QuobyteHD#QuobyteHD',id=f4a18d67-0b7f-4d80-a106-41a848891329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49f3cb1d10a44cd94588bd6a166f9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:13Z,use_quota=True,user_id='cf27d8284c04416ba24de6e80433521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22c3eb33-6713-441d-8998-a261502f58c2),volume_type_id=22c3eb33-6713-441d-8998-a261502f58c2)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Creating volume f4a18d67-0b7f-4d80-a106-41a848891329 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:28:13 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:28:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:13 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 1073741824 Jul 08 03:28:13 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:14 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 1073741824" returned: 0 in 1.265s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:14 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 Jul 08 03:28:14 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:15 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329" returned: 0 in 0.913s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c375fe-5f68-4211-ad3d-5688f67123a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a18d67-0b7f-4d80-a106-41a848891329', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07d9d16-1c30-487c-b360-077e2750f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Volume volume-f4a18d67-0b7f-4d80-a106-41a848891329 (f4a18d67-0b7f-4d80-a106-41a848891329): created successfully Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07d9d16-1c30-487c-b360-077e2750f43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Flow 'volume_create_manager' (cfef4bf5-24d8-49dd-b295-a617bd915a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0b9980a1-c0fd-4e23-a755-d01a2f5fa433 tempest-GroupsTest-1960926890 None] Created volume successfully. Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Flow 'volume_create_manager' (eec8fbf5-7d5c-4ed3-a926-1292b2bb42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0814e4de-6e6b-432b-8bf2-85d9540e2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0814e4de-6e6b-432b-8bf2-85d9540e2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420295041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5cc3a66-e7dd-4bd2-acc7-6e1e4e139dc8,host='devstack@QuobyteHD#QuobyteHD',id=b5935127-66f2-4a96-800d-3e55ab31d28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49f3cb1d10a44cd94588bd6a166f9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:18Z,use_quota=True,user_id='cf27d8284c04416ba24de6e80433521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22c3eb33-6713-441d-8998-a261502f58c2),volume_type_id=22c3eb33-6713-441d-8998-a261502f58c2)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0742821-00a6-46e6-9abb-2f0e6e8bac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0742821-00a6-46e6-9abb-2f0e6e8bac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d10055e-d0fd-4290-aa94-f0dcae2b2ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d10055e-d0fd-4290-aa94-f0dcae2b2ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5935127-66f2-4a96-800d-3e55ab31d28b', 'volume_name': 'volume-b5935127-66f2-4a96-800d-3e55ab31d28b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fac6aa-9303-4927-b62d-f26bb385ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fac6aa-9303-4927-b62d-f26bb385ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cfa6d9-2c95-4c0c-b1a4-e2a6bf75f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:18 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Volume b5935127-66f2-4a96-800d-3e55ab31d28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5935127-66f2-4a96-800d-3e55ab31d28b', 'volume_size': 1} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5cc3a66-e7dd-4bd2-acc7-6e1e4e139dc8,created_at=2026-07-08T01:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420295041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5cc3a66-e7dd-4bd2-acc7-6e1e4e139dc8,host='devstack@QuobyteHD#QuobyteHD',id=b5935127-66f2-4a96-800d-3e55ab31d28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49f3cb1d10a44cd94588bd6a166f9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:18Z,use_quota=True,user_id='cf27d8284c04416ba24de6e80433521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22c3eb33-6713-441d-8998-a261502f58c2),volume_type_id=22c3eb33-6713-441d-8998-a261502f58c2)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Creating volume b5935127-66f2-4a96-800d-3e55ab31d28b {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:28:18 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:28:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:18 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b 1073741824 Jul 08 03:28:18 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:19 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b 1073741824" returned: 0 in 1.192s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:19 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=47,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:28:19 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=55,cinder:SELECT=37,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:28:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:19 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b Jul 08 03:28:19 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:20 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b" returned: 0 in 0.707s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cfa6d9-2c95-4c0c-b1a4-e2a6bf75f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5935127-66f2-4a96-800d-3e55ab31d28b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b22b6b-4593-40b9-9f42-9a14be78017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Volume volume-b5935127-66f2-4a96-800d-3e55ab31d28b (b5935127-66f2-4a96-800d-3e55ab31d28b): created successfully Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b22b6b-4593-40b9-9f42-9a14be78017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Flow 'volume_create_manager' (eec8fbf5-7d5c-4ed3-a926-1292b2bb42a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-cc84eca9-6652-4a2b-9a89-ba96e927633c tempest-GroupsTest-1960926890 None] Created volume successfully. Jul 08 03:28:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f8334aae-1b6f-4d68-925d-0773d6c22c5e tempest-GroupsTest-1960926890 None] Update group completed successfully. Jul 08 03:28:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fff3013d-4625-4d37-b43a-003f65f1ae48 tempest-GroupsTest-1960926890 None] Update group completed successfully. Jul 08 03:28:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Acquiring lock "cinder-quobyte-b5935127-66f2-4a96-800d-3e55ab31d28b" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:28:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Lock "cinder-quobyte-b5935127-66f2-4a96-800d-3e55ab31d28b" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:28:23 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8224d2-5347-4099-b9f4-8b06e49cf95f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:24 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b Jul 08 03:28:24 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:24 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b" returned: 0 in 0.817s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:24 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b Jul 08 03:28:24 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:25 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b5935127-66f2-4a96-800d-3e55ab31d28b" returned: 0 in 0.678s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Lock "cinder-quobyte-b5935127-66f2-4a96-800d-3e55ab31d28b" released by "delete_volume" :: held 1.551s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:28:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Acquiring lock "cinder-quobyte-f4a18d67-0b7f-4d80-a106-41a848891329" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:28:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Lock "cinder-quobyte-f4a18d67-0b7f-4d80-a106-41a848891329" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:28:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ab0a9-f381-422a-877c-e9a9c3dc2f46]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:25 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 Jul 08 03:28:25 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:26 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:26 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329 Jul 08 03:28:26 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:26 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:28:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Flow 'volume_create_manager' (66a25f57-866c-4a1d-9636-b2493eafd643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8914c-e1a2-4ff3-9e67-ca42beb4828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8914c-e1a2-4ff3-9e67-ca42beb4828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-612719571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f575189-4827-4563-9b91-3db5e6170308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44c4d36b43a40c19dcbc6f0d61c6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:27Z,use_quota=True,user_id='4ac0f13f4d5342af81ca7fcec9e58ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e03697-c445-4153-9d2b-eb55baa78de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e03697-c445-4153-9d2b-eb55baa78de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175e4399-1770-45c2-a3da-b07a64c4c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175e4399-1770-45c2-a3da-b07a64c4c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f575189-4827-4563-9b91-3db5e6170308', 'volume_name': 'volume-3f575189-4827-4563-9b91-3db5e6170308', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fd9f43-7089-40d2-9468-a65798123675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fd9f43-7089-40d2-9468-a65798123675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca6da78-6537-4947-82a9-3c856c0c0ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Volume 3f575189-4827-4563-9b91-3db5e6170308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f575189-4827-4563-9b91-3db5e6170308', 'volume_size': 1} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-612719571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f575189-4827-4563-9b91-3db5e6170308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44c4d36b43a40c19dcbc6f0d61c6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:27Z,use_quota=True,user_id='4ac0f13f4d5342af81ca7fcec9e58ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Creating volume 3f575189-4827-4563-9b91-3db5e6170308 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:28:27 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:27 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 1073741824 Jul 08 03:28:27 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:27 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4a18d67-0b7f-4d80-a106-41a848891329" returned: 0 in 0.974s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Lock "cinder-quobyte-f4a18d67-0b7f-4d80-a106-41a848891329" released by "delete_volume" :: held 1.807s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Created reservations ['eada8e8b-0d7b-4cfe-9021-78bf150be132'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:27 devstack cinder-volume[86294]: WARNING cinder.quota [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-139444033 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-139444033, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:28:27 devstack cinder-volume[86294]: WARNING cinder.quota [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-139444033 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-139444033, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Created reservations ['bfde8518-a8df-47be-9ac4-6066722d9fc7', 'c381deb7-a4ba-48d9-9f62-1b25c6577545', '972316e4-a621-4da5-8b4d-492d82668c0d', 'd756fa86-fa9b-4452-819c-6a77028a3bab'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Created reservations ['88de3ca9-5ab4-4e1e-a54a-ae17d4d50ea0', '45a15adf-56eb-49c2-b1b3-1851566ace4a', 'c2ff7269-be1a-484b-b442-9fe1af38de2a', '7053f83c-2ad7-4180-90df-301c5baa3bbf'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:27 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:28:27 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:28 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 1073741824" returned: 0 in 0.999s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:28 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 Jul 08 03:28:28 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:28 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:28:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a2286c1c-5650-45e2-b6f9-6add1b6dea50 tempest-GroupsTest-1960926890 None] Delete group completed successfully. Jul 08 03:28:28 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308" returned: 0 in 0.731s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca6da78-6537-4947-82a9-3c856c0c0ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f575189-4827-4563-9b91-3db5e6170308', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347541f4-8b46-41e4-82fb-bf8d0dba7115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:28 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Volume volume-3f575189-4827-4563-9b91-3db5e6170308 (3f575189-4827-4563-9b91-3db5e6170308): created successfully Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347541f4-8b46-41e4-82fb-bf8d0dba7115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Flow 'volume_create_manager' (66a25f57-866c-4a1d-9636-b2493eafd643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4457b8a0-d1be-4ce4-9218-7cb5597c0c5d tempest-AttachVolumeTestJSON-466969227 None] Created volume successfully. Jul 08 03:28:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:33 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c84ca27-8ff4-41d4-b857-bdf2fd03f4f0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:33 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 Jul 08 03:28:33 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:33 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308" returned: 0 in 0.888s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-3f575189-4827-4563-9b91-3db5e6170308', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63630c4b-cae0-47a9-be18-3761bbf5f30e', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:28:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-956f34bd-9834-4316-b3ef-ce3e2409b4e6 req-c697b5dc-5d52-4c73-8b7c-eb2b86c551ba tempest-AttachVolumeTestJSON-466969227 None] attachment_update completed successfully. Jul 08 03:28:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:42 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c208d81-eac4-40ef-965d-cd78f43f6783]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:42 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d Jul 08 03:28:42 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:43 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-fc52968f-0673-4320-8688-1846a696752d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ace3c9a-b58c-41a2-aaa9-13d28d36655c', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:28:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-3aca2131-0f7c-4fde-a446-92cc5f2754b3 req-22794806-218d-4b27-aa8f-ecd64b01ace9 tempest-ServerActionsTestOtherA-11905986 None] attachment_update completed successfully. Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Flow 'volume_create_manager' (8b647f5b-859c-49d0-9345-2e8ede108232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fb59bf-275d-44bd-826e-ab0b0a768b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fb59bf-275d-44bd-826e-ab0b0a768b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-841854414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318e6d60-8b63-42fe-80d8-e7dcfea0498d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff47de91b6a4ea9bad5a43fd51f242b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:45Z,use_quota=True,user_id='8ee1178885fc4e87b45b993fd75638aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b43adfc6-a2b0-4edb-9188-10b097ee8dae),volume_type_id=b43adfc6-a2b0-4edb-9188-10b097ee8dae)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6c5bc4-069b-4d80-93fd-c2998e2acc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6c5bc4-069b-4d80-93fd-c2998e2acc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274d93d7-b30d-4f28-9809-f6e541a75dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274d93d7-b30d-4f28-9809-f6e541a75dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318e6d60-8b63-42fe-80d8-e7dcfea0498d', 'volume_name': 'volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053a17aa-932a-4aed-a027-6c0978a93227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053a17aa-932a-4aed-a027-6c0978a93227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06a2420-83c0-4bed-930c-ca3bfc1776a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:44 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Volume 318e6d60-8b63-42fe-80d8-e7dcfea0498d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d', 'volume_size': 1} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-841854414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318e6d60-8b63-42fe-80d8-e7dcfea0498d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff47de91b6a4ea9bad5a43fd51f242b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:28:45Z,use_quota=True,user_id='8ee1178885fc4e87b45b993fd75638aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b43adfc6-a2b0-4edb-9188-10b097ee8dae),volume_type_id=b43adfc6-a2b0-4edb-9188-10b097ee8dae)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Creating volume 318e6d60-8b63-42fe-80d8-e7dcfea0498d {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:28:44 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:28:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:44 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d 1073741824 Jul 08 03:28:44 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:45 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d 1073741824" returned: 0 in 0.876s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:45 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d Jul 08 03:28:45 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:46 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.028s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06a2420-83c0-4bed-930c-ca3bfc1776a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc73158-1e9e-4c62-9356-6063d190f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8b95d7-37b6-44d7-8189-2e5ae7310280]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:46 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Volume volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d (318e6d60-8b63-42fe-80d8-e7dcfea0498d): created successfully Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc73158-1e9e-4c62-9356-6063d190f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Flow 'volume_create_manager' (8b647f5b-859c-49d0-9345-2e8ede108232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:28:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c93c79ad-5138-406d-b459-7a29c854c511 tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Created volume successfully. Jul 08 03:28:46 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d Jul 08 03:28:46 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:46 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:28:46 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:47 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d" returned: 0 in 0.805s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-b7891472-3595-435c-a8fd-3f6be422a77d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b4c973f-5c7b-4eda-8fc4-d4b42fdc7eff', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:28:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-70b61f3d-d84f-46d0-8436-6092c6d6d4d0 req-06251552-8ede-4ea8-a3a4-251661411d8f tempest-TaggedAttachmentsTest-1779520448 None] attachment_update completed successfully. Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:47 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:28:47 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:47 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 8 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:28:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:28:48 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.708s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:28:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-40e24ba0-a4b1-4fe5-bc57-f1a8e22bb17a tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Retype volume completed successfully. Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Acquiring lock "cinder-318e6d60-8b63-42fe-80d8-e7dcfea0498d-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "cinder-318e6d60-8b63-42fe-80d8-e7dcfea0498d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Acquiring lock "cinder-quobyte-318e6d60-8b63-42fe-80d8-e7dcfea0498d" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "cinder-quobyte-318e6d60-8b63-42fe-80d8-e7dcfea0498d" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d9fe0-8620-446a-b267-97094ee549cf]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:49 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d Jul 08 03:28:49 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:49 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d" returned: 0 in 0.790s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:49 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d Jul 08 03:28:49 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:50 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-318e6d60-8b63-42fe-80d8-e7dcfea0498d" returned: 0 in 0.861s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "cinder-quobyte-318e6d60-8b63-42fe-80d8-e7dcfea0498d" released by "delete_volume" :: held 1.694s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:28:50 devstack cinder-volume[86294]: WARNING cinder.quota [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:28:50 devstack cinder-volume[86294]: WARNING cinder.quota [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Created reservations ['22f54bd6-e47d-41b3-9651-36200d46b3f6', '7e89c4a5-3630-4371-ac04-414786725d4b', 'c343d45b-1336-4d3b-8b7b-93dda33c8e7d', '1ab60086-63e2-4262-9b8e-329318e35384'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:50 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:28:50 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-02b93728-05c5-426a-b8a1-f8f487961521 req-64c0ff27-cdb1-4c41-b5b0-01c40ada47c4 tempest-ServerActionsTestOtherA-11905986 None] Terminate volume connection completed successfully. Jul 08 03:28:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-02b93728-05c5-426a-b8a1-f8f487961521 req-64c0ff27-cdb1-4c41-b5b0-01c40ada47c4 tempest-ServerActionsTestOtherA-11905986 None] Deleting attachment 1ace3c9a-b58c-41a2-aaa9-13d28d36655c. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:28:51 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.747s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:51 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:28:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Deleted volume successfully. Jul 08 03:28:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-487a3496-5f8d-490c-8506-a53de5dc251e tempest-VolumeRetypeWithoutMigrationTest-8622906 None] Lock "cinder-318e6d60-8b63-42fe-80d8-e7dcfea0498d-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:28:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:28:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:28:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[08564bbd-734f-4890-8b6f-48b4b96395f8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:28:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:28:54 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d Jul 08 03:28:54 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:28:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-3938cf1c-4e48-47b8-afcb-85acb9cb9c85 req-8ff71b58-8cde-467e-85e0-c46603d60a06 tempest-TaggedAttachmentsTest-1779520448 None] Terminate volume connection completed successfully. Jul 08 03:28:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-3938cf1c-4e48-47b8-afcb-85acb9cb9c85 req-8ff71b58-8cde-467e-85e0-c46603d60a06 tempest-TaggedAttachmentsTest-1779520448 None] Deleting attachment 7b4c973f-5c7b-4eda-8fc4-d4b42fdc7eff. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:28:55 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jul 08 03:28:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d" returned: 0 in 1.583s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:28:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.620s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:28:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-fc52968f-0673-4320-8688-1846a696752d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81da2506-c284-43c0-ae1b-51dd034cff21', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:28:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-02b93728-05c5-426a-b8a1-f8f487961521 req-b5f31633-164c-474d-926d-8dd705f8285c tempest-ServerActionsTestOtherA-11905986 None] attachment_update completed successfully. Jul 08 03:29:05 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=49,cinder:SELECT=59,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:29:05 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=56,cinder:INSERT=7,cinder:UPDATE=45,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:29:06 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:29:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Flow 'volume_create_manager' (435d6b82-101d-4ddf-9eed-ee5d232b940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59194612-fffc-49bf-b9e4-b89e1b1f9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59194612-fffc-49bf-b9e4-b89e1b1f9218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-982620481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99b6c60-bcb9-4525-8687-9819cd114185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f2350145c343c19d1aef2ed75d8aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:29:07Z,use_quota=True,user_id='b537ce6862fa42f585d948520d8c57a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e24d0ef8-5f5b-458a-9f32-f9fbe222adf2),volume_type_id=e24d0ef8-5f5b-458a-9f32-f9fbe222adf2)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03308fc-eaa2-4ea1-876e-0b53661bca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03308fc-eaa2-4ea1-876e-0b53661bca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158c816e-eb51-4b4d-8051-5738a6a9b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158c816e-eb51-4b4d-8051-5738a6a9b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99b6c60-bcb9-4525-8687-9819cd114185', 'volume_name': 'volume-e99b6c60-bcb9-4525-8687-9819cd114185', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df68eb86-a20d-4065-baba-6695ba2ca568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df68eb86-a20d-4065-baba-6695ba2ca568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e940c-c5fe-4426-8faf-5c3cafcbad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Volume e99b6c60-bcb9-4525-8687-9819cd114185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99b6c60-bcb9-4525-8687-9819cd114185', 'volume_size': 1} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-982620481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99b6c60-bcb9-4525-8687-9819cd114185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f2350145c343c19d1aef2ed75d8aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:29:07Z,use_quota=True,user_id='b537ce6862fa42f585d948520d8c57a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e24d0ef8-5f5b-458a-9f32-f9fbe222adf2),volume_type_id=e24d0ef8-5f5b-458a-9f32-f9fbe222adf2)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Creating volume e99b6c60-bcb9-4525-8687-9819cd114185 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:29:07 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:29:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:07 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 1073741824 Jul 08 03:29:07 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:08 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 1073741824" returned: 0 in 1.153s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:08 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 Jul 08 03:29:08 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:09 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185" returned: 0 in 1.038s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e940c-c5fe-4426-8faf-5c3cafcbad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99b6c60-bcb9-4525-8687-9819cd114185', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f917fd01-524f-4d03-9322-e5fe957570d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:09 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Volume volume-e99b6c60-bcb9-4525-8687-9819cd114185 (e99b6c60-bcb9-4525-8687-9819cd114185): created successfully Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f917fd01-524f-4d03-9322-e5fe957570d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Flow 'volume_create_manager' (435d6b82-101d-4ddf-9eed-ee5d232b940a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:29:09 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7e241942-afc2-42a9-ba08-9c53fdcf2813 tempest-VolumeTypesAccessTest-1855198295 None] Created volume successfully. Jul 08 03:29:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Acquiring lock "cinder-e99b6c60-bcb9-4525-8687-9819cd114185-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Lock "cinder-e99b6c60-bcb9-4525-8687-9819cd114185-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Acquiring lock "cinder-quobyte-e99b6c60-bcb9-4525-8687-9819cd114185" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Lock "cinder-quobyte-e99b6c60-bcb9-4525-8687-9819cd114185" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:10 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf522040-6a31-4f36-ae42-6625376158a4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:10 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 Jul 08 03:29:10 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:11 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185" returned: 0 in 0.794s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:11 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185 Jul 08 03:29:11 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:11 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e99b6c60-bcb9-4525-8687-9819cd114185" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Lock "cinder-quobyte-e99b6c60-bcb9-4525-8687-9819cd114185" released by "delete_volume" :: held 1.483s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:11 devstack cinder-volume[86294]: WARNING cinder.quota [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-770530284 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-770530284, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:29:11 devstack cinder-volume[86294]: WARNING cinder.quota [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-770530284 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-770530284, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Created reservations ['276a7f32-dff8-4ab6-b4c8-99671c53cd61', '7411f300-af4b-4091-b3e4-670e1cdb3083', '95678358-cba4-4868-94ff-12eed6e89f7e', 'e99246bf-8ff5-4c85-ba40-517587dceea3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:11 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:29:11 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:12 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:12 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:29:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Deleted volume successfully. Jul 08 03:29:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9a99a6b4-52a0-496e-95c8-827e455833a3 tempest-VolumeTypesAccessTest-1855198295 None] Lock "cinder-e99b6c60-bcb9-4525-8687-9819cd114185-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Acquiring lock "cinder-b7891472-3595-435c-a8fd-3f6be422a77d-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Lock "cinder-b7891472-3595-435c-a8fd-3f6be422a77d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Acquiring lock "cinder-quobyte-b7891472-3595-435c-a8fd-3f6be422a77d" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Lock "cinder-quobyte-b7891472-3595-435c-a8fd-3f6be422a77d" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a85f96-eaab-4575-a30e-64d1e409226a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:16 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d Jul 08 03:29:16 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:17 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d" returned: 0 in 1.134s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:17 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d Jul 08 03:29:17 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:18 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b7891472-3595-435c-a8fd-3f6be422a77d" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Lock "cinder-quobyte-b7891472-3595-435c-a8fd-3f6be422a77d" released by "delete_volume" :: held 1.903s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Created reservations ['79e62d3c-1cef-41ca-9467-195a59f8e0f1', 'c369975c-9667-458a-a895-686c8dde6878', '70a88a11-19fd-453e-9620-866c62a905ef', '62fb76c9-78d1-40e0-9b07-0640201af695'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:18 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:29:18 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:19 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.861s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:19 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:29:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Deleted volume successfully. Jul 08 03:29:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-da7705f4-0a56-45b4-bec7-a0205de9dc83 tempest-TaggedAttachmentsTest-1779520448 None] Lock "cinder-b7891472-3595-435c-a8fd-3f6be422a77d-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-4f08b85a-53c8-431b-802a-21223793ee8b req-6c91e95a-46b4-4e29-b487-e5123b0bf09e tempest-AttachVolumeTestJSON-466969227 None] Terminate volume connection completed successfully. Jul 08 03:29:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-4f08b85a-53c8-431b-802a-21223793ee8b req-6c91e95a-46b4-4e29-b487-e5123b0bf09e tempest-AttachVolumeTestJSON-466969227 None] Deleting attachment 63630c4b-cae0-47a9-be18-3761bbf5f30e. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Flow 'volume_create_manager' (93b83afb-08f2-4cc1-9040-81a55fe90a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9584681-0712-40ef-a902-43c23a73bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9584681-0712-40ef-a902-43c23a73bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1479703202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0fbc97f93a47fbacd4b445ac18d17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:29:26Z,use_quota=True,user_id='1d767bee1e044e679664899aa9bfcc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb320236-8d2b-426a-9d73-ab1df76f8e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb320236-8d2b-426a-9d73-ab1df76f8e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a965c972-67dd-47a4-b243-aa6321713515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a965c972-67dd-47a4-b243-aa6321713515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825', 'volume_name': 'volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad760fd-4e4d-4529-919f-c372e6028bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad760fd-4e4d-4529-919f-c372e6028bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c402a733-79ed-4197-ab7b-a2cd1f1e61d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:26 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Volume 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 03:29:26 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Trying to clone 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 from image ad206503-c10d-4ca1-92a8-b1a38f579b05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:29:27 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:29:27 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Image download 20.69 MB at 20.69 MB/s Jul 08 03:29:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130e740-0a21-449f-83ad-c4cb6e5b3318]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:27 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD Jul 08 03:29:27 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:28 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 is fetched for user 1d767bee1e044e679664899aa9bfcc09. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[66534ef2-b73c-4358-85a0-bdc6fc11475a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:28 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD Jul 08 03:29:28 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:28 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1479703202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0fbc97f93a47fbacd4b445ac18d17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:29:26Z,use_quota=True,user_id='1d767bee1e044e679664899aa9bfcc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Creating volume 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:29:28 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:29:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:28 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 1073741824 Jul 08 03:29:28 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:29 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 1073741824" returned: 0 in 0.871s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:29 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:29 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-25d0ef35-b5aa-4ce4-85e6-60e67c031efe req-79873807-2a86-4c4f-b782-387df007d383 tempest-ServerActionsTestOtherA-11905986 None] Terminate volume connection completed successfully. Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-25d0ef35-b5aa-4ce4-85e6-60e67c031efe req-79873807-2a86-4c4f-b782-387df007d383 tempest-ServerActionsTestOtherA-11905986 None] Deleting attachment 81da2506-c284-43c0-ae1b-51dd034cff21. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:29:30 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 0 in 0.928s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Attempting download of ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[61754c57-3959-4084-ac46-d4bdcfcf64c8]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:31 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3 Jul 08 03:29:31 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:31 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3" returned: 0 in 0.844s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:31 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3 Jul 08 03:29:31 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:32 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3" returned: 1 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_bq3x4mg3' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:29:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf8380-5807-4fa8-a02a-3cc3576d593d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:32 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD Jul 08 03:29:32 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:33 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD" returned: 0 in 0.952s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:33 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] ad206503-c10d-4ca1-92a8-b1a38f579b05 was qcow2, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:29:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:33 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:33 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:36 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 0 in 3.175s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:36 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_7s5e1k1fdevstack@QuobyteHD, size 112.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:29:36 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Converted 112.00 MB image at 35.25 MB/s Jul 08 03:29:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:36 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 1G Jul 08 03:29:36 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:37 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 1G" returned: 0 in 1.249s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:38 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9985844f-f9c4-4ea6-a3bb-e253549e2faa]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:38 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:38 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:39 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 0 in 1.112s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:39 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:39 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:40 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 1 in 1.033s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Downloaded image ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 for user 1d767bee1e044e679664899aa9bfcc09 is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Marking volume 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Copying metadata from image ad206503-c10d-4ca1-92a8-b1a38f579b05 to 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Creating volume glance metadata for volume 60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 backed by image ad206503-c10d-4ca1-92a8-b1a38f579b05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c402a733-79ed-4197-ab7b-a2cd1f1e61d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c83253-c390-481e-a469-64edbb052349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Volume volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 (60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825): created successfully Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c83253-c390-481e-a469-64edbb052349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Flow 'volume_create_manager' (93b83afb-08f2-4cc1-9040-81a55fe90a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:29:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-cf4d7bd7-390b-45d5-b384-0d09c264f881 tempest-VolumesImageMetadata-2102253012 None] Created volume successfully. Jul 08 03:29:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Acquiring lock "cinder-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Lock "cinder-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Acquiring lock "cinder-quobyte-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Lock "cinder-quobyte-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:42 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69d032f-305b-48f7-90fb-838cb9d75b36]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:42 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:42 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:43 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 0 in 1.137s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:43 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:43 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "cinder-fc52968f-0673-4320-8688-1846a696752d-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Lock "cinder-fc52968f-0673-4320-8688-1846a696752d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "cinder-quobyte-fc52968f-0673-4320-8688-1846a696752d" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Lock "cinder-quobyte-fc52968f-0673-4320-8688-1846a696752d" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c4f5e6-1fdb-4290-8a3a-c34f0d6da7f1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:44 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d Jul 08 03:29:44 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:44 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 1 in 1.390s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:29:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:44 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825 Jul 08 03:29:44 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:45 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d" returned: 0 in 1.174s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:45 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d Jul 08 03:29:45 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:45 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" returned: 0 in 0.914s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Lock "cinder-quobyte-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825" released by "delete_volume" :: held 3.575s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:45 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Created reservations ['3dc5d7cf-cd43-4052-b57e-5a9d49e09709', 'f4a5960c-f3b1-48f2-89da-5c426e4f721b', 'b8a66507-b41b-481b-8453-be699f73bddc', '5ab51c00-bf9b-49db-a48c-06a59a02603c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:46 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:29:46 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:46 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fc52968f-0673-4320-8688-1846a696752d" returned: 0 in 1.025s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Lock "cinder-quobyte-fc52968f-0673-4320-8688-1846a696752d" released by "delete_volume" :: held 2.255s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Created reservations ['260c6b04-38ef-42f2-9602-cb3b1447f8ec', '03f9a6f2-e981-4cb6-83ae-1f1cf8c19340', 'a8164005-9602-405b-a2c0-6ebcc0c9a536', '9c8cf826-9b7f-4b0f-bda7-9ed1e05a5f4c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:46 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:29:46 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:46 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.924s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:29:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Deleted volume successfully. Jul 08 03:29:47 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:29:47 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-49b024b1-eb26-4a6e-ab34-1de3dba84ad5 tempest-VolumesImageMetadata-2102253012 None] Lock "cinder-60a8a5d5-4802-4ad6-be2c-0fe7ebbf7825-delete_volume" released by "delete_volume" :: held 4.849s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:47 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:29:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Deleted volume successfully. Jul 08 03:29:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-498b42fe-6ac0-4bf6-ac9e-4b4c6d3b317b tempest-ServerActionsTestOtherA-11905986 None] Lock "cinder-fc52968f-0673-4320-8688-1846a696752d-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:48 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.039s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:48 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:29:48 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:29:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:29:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Flow 'volume_create_manager' (99cb3a3a-afc5-417e-aeee-dbe8e96fa51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baedba3c-5fed-437d-8a45-bcb245ad00e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baedba3c-5fed-437d-8a45-bcb245ad00e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1593325331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f2f164-0c77-4f63-b956-33d40f303e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b783b0251cc548f3adc09fde623e762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:29:52Z,use_quota=True,user_id='fe7457a2fa8e439b99404016c30ac5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944a91cf-d935-43d4-94f9-66be7619d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944a91cf-d935-43d4-94f9-66be7619d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8e40bf-4db2-4efe-aa0b-8b871b8c434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8e40bf-4db2-4efe-aa0b-8b871b8c434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f2f164-0c77-4f63-b956-33d40f303e47', 'volume_name': 'volume-a7f2f164-0c77-4f63-b956-33d40f303e47', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5647a39c-485e-45c0-b9fb-59c717357ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5647a39c-485e-45c0-b9fb-59c717357ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ee428b-1863-4248-b1e0-c7acf9089d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Volume a7f2f164-0c77-4f63-b956-33d40f303e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f2f164-0c77-4f63-b956-33d40f303e47', 'volume_size': 1} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1593325331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f2f164-0c77-4f63-b956-33d40f303e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b783b0251cc548f3adc09fde623e762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:29:52Z,use_quota=True,user_id='fe7457a2fa8e439b99404016c30ac5ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Creating volume a7f2f164-0c77-4f63-b956-33d40f303e47 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:29:52 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:29:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:52 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 1073741824 Jul 08 03:29:52 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:53 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 1073741824" returned: 0 in 1.082s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:53 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 Jul 08 03:29:53 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:54 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ee428b-1863-4248-b1e0-c7acf9089d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f2f164-0c77-4f63-b956-33d40f303e47', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910710ee-b528-472e-ab90-e29310b203af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:29:54 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Volume volume-a7f2f164-0c77-4f63-b956-33d40f303e47 (a7f2f164-0c77-4f63-b956-33d40f303e47): created successfully Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910710ee-b528-472e-ab90-e29310b203af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:29:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Flow 'volume_create_manager' (99cb3a3a-afc5-417e-aeee-dbe8e96fa51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:29:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5edcd007-06d9-43f6-b6a2-ae13de33ac35 tempest-AbsoluteLimitsTests-1504907483 None] Created volume successfully. Jul 08 03:29:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Acquiring lock "cinder-a7f2f164-0c77-4f63-b956-33d40f303e47-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Lock "cinder-a7f2f164-0c77-4f63-b956-33d40f303e47-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Acquiring lock "cinder-quobyte-a7f2f164-0c77-4f63-b956-33d40f303e47" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:29:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Lock "cinder-quobyte-a7f2f164-0c77-4f63-b956-33d40f303e47" acquired by "delete_volume" :: waited 0.051s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:29:55 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[93551f65-4e45-41b9-adfb-72be037a6de1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:29:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:56 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 Jul 08 03:29:56 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:56 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47" returned: 0 in 0.985s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:56 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47 Jul 08 03:29:56 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a7f2f164-0c77-4f63-b956-33d40f303e47" returned: 0 in 0.704s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:57 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Lock "cinder-quobyte-a7f2f164-0c77-4f63-b956-33d40f303e47" released by "delete_volume" :: held 1.758s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Created reservations ['90101a3a-f5c5-49d6-a03f-c1225a9e5fbb', '24cbae12-624d-4cf8-a1c4-b0b573f972d2', '3409a747-3902-444f-9db9-6c3f616d9e46', 'c4561075-fbb4-491e-bea6-6bcd6bb9fdae'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:29:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:29:57 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:29:57 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:29:59 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 08 03:29:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.698s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:29:59 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:29:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Deleted volume successfully. Jul 08 03:29:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2491604e-3ade-458a-8ddd-c6a880792cc3 tempest-AbsoluteLimitsTests-1504907483 None] Lock "cinder-a7f2f164-0c77-4f63-b956-33d40f303e47-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:07 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=36,cinder:UPDATE=52,cinder:INSERT=20,cinder:DELETE=2 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:30:09 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=46,cinder:UPDATE=50,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Flow 'volume_create_manager' (557d818d-0cb2-47e5-b66c-7c92b1909951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a86e6e-2a43-4e6f-9b30-b9ed9f914852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a86e6e-2a43-4e6f-9b30-b9ed9f914852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2081277977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7359b8-40bf-4aea-8fa2-b9fddd06a72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6057ea0de9d743d980d1265c917757d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:12Z,use_quota=True,user_id='729b8bd1c77c4613a94a20110907fa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8d866-f8eb-4caa-b677-91a3dd2fcff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8d866-f8eb-4caa-b677-91a3dd2fcff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766d517d-d40d-428d-980a-20e9239301df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766d517d-d40d-428d-980a-20e9239301df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7359b8-40bf-4aea-8fa2-b9fddd06a72b', 'volume_name': 'volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abee3f7-8797-4de6-96b4-3721c74fa6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abee3f7-8797-4de6-96b4-3721c74fa6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbebf85-8c25-48c9-afb4-080960698f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:11 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Volume ba7359b8-40bf-4aea-8fa2-b9fddd06a72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b', 'volume_size': 1} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2081277977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7359b8-40bf-4aea-8fa2-b9fddd06a72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6057ea0de9d743d980d1265c917757d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:12Z,use_quota=True,user_id='729b8bd1c77c4613a94a20110907fa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Creating volume ba7359b8-40bf-4aea-8fa2-b9fddd06a72b {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:30:11 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:30:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:11 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b 1073741824 Jul 08 03:30:11 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:13 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b 1073741824" returned: 0 in 1.271s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:13 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b Jul 08 03:30:13 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:13 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbebf85-8c25-48c9-afb4-080960698f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13467eb-3235-4d5a-81cd-20f3bef93b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:13 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Volume volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b (ba7359b8-40bf-4aea-8fa2-b9fddd06a72b): created successfully Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13467eb-3235-4d5a-81cd-20f3bef93b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Flow 'volume_create_manager' (557d818d-0cb2-47e5-b66c-7c92b1909951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e2958f0b-59d6-4b3f-9311-b1496a12ffab tempest-VolumesTransfersV357Test-1914184922 None] Created volume successfully. Jul 08 03:30:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d2d56b80-3483-4fc2-86cd-35212f5c2d53 tempest-VolumesTransfersV357Test-2120368422 None] Transfer volume completed successfully. Jul 08 03:30:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Acquiring lock "cinder-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:30:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:30:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Acquiring lock "cinder-quobyte-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:30:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-quobyte-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:30:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa12a12f-0f98-4355-a31a-12ca2b5feb5a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:17 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b Jul 08 03:30:17 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:18 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b" returned: 0 in 1.271s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:18 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b Jul 08 03:30:18 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:19 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b" returned: 0 in 1.162s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-quobyte-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b" released by "delete_volume" :: held 2.517s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Created reservations ['8d7172e7-202c-46e4-a9de-78f0870be358', 'f07ee7c7-c596-497c-a51c-cf0e73ae6a8c', '4ee49553-2255-4276-ba5a-1f522944d814', '35ca0d5e-6eec-4112-9c7c-5482f9d7e67e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:19 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:30:19 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Flow 'volume_create_manager' (e9b378ed-3d1e-4f7d-a2d0-8c556208f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd33134-eb48-4eb8-8d3b-4053454f1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd33134-eb48-4eb8-8d3b-4053454f1db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-42871659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7945607dd72b4be19855f42c2a9a010a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:21Z,use_quota=True,user_id='bc4bd9d9d1c543cfa89155c013f25646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6e1ecb-7718-4d9c-a6fd-3d323c5d7b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6e1ecb-7718-4d9c-a6fd-3d323c5d7b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c2a632-672a-4859-8540-d464cdcf429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c2a632-672a-4859-8540-d464cdcf429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5', 'volume_name': 'volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143dec08-c931-4f01-97c0-baf230923cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143dec08-c931-4f01-97c0-baf230923cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c15c0d7-9e9e-4717-9fe2-57c57cc0da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Volume 383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5', 'volume_size': 1} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-42871659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7945607dd72b4be19855f42c2a9a010a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:21Z,use_quota=True,user_id='bc4bd9d9d1c543cfa89155c013f25646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Creating volume 383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:30:20 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:20 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 1073741824 Jul 08 03:30:20 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:20 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.403s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:20 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:30:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Deleted volume successfully. Jul 08 03:30:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e0375166-7ccd-4b64-b2ac-e69f6a64eadb tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-ba7359b8-40bf-4aea-8fa2-b9fddd06a72b-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Flow 'volume_create_manager' (9d385be7-3c30-4242-a524-16b109b3c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68dea8fe-19be-43c5-abee-0bc6b4a4d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68dea8fe-19be-43c5-abee-0bc6b4a4d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1028006689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a9536a-130b-42b7-b067-a0dc7985cddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6057ea0de9d743d980d1265c917757d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:22Z,use_quota=True,user_id='729b8bd1c77c4613a94a20110907fa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8fc65d-26e9-456e-a393-1592e1a04068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8fc65d-26e9-456e-a393-1592e1a04068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a4a5b-9712-49e1-b03b-260b98d31909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a4a5b-9712-49e1-b03b-260b98d31909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a9536a-130b-42b7-b067-a0dc7985cddf', 'volume_name': 'volume-00a9536a-130b-42b7-b067-a0dc7985cddf', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76020331-2569-4999-9f56-4202324ecd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76020331-2569-4999-9f56-4202324ecd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dfa0f7-fb71-4f2a-9c8c-ce40a4b932cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Volume 00a9536a-130b-42b7-b067-a0dc7985cddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a9536a-130b-42b7-b067-a0dc7985cddf', 'volume_size': 1} Jul 08 03:30:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:23 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 1073741824" returned: 0 in 2.283s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:23 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 Jul 08 03:30:23 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:24 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5" returned: 0 in 1.452s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] <== create_volume: return (3983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.986s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.545s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1028006689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a9536a-130b-42b7-b067-a0dc7985cddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6057ea0de9d743d980d1265c917757d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:22Z,use_quota=True,user_id='729b8bd1c77c4613a94a20110907fa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Creating volume 00a9536a-130b-42b7-b067-a0dc7985cddf {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:30:24 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c15c0d7-9e9e-4717-9fe2-57c57cc0da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:24 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf 1073741824 Jul 08 03:30:24 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f45ec0-7846-409e-be95-9973cd9cf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:24 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Volume volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 (383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5): created successfully Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f45ec0-7846-409e-be95-9973cd9cf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Flow 'volume_create_manager' (e9b378ed-3d1e-4f7d-a2d0-8c556208f6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5b84bc75-824f-4bf4-8777-55a3df10c32f tempest-ServerRescueNegativeTestJSON-1113042786 None] Created volume successfully. Jul 08 03:30:26 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf 1073741824" returned: 0 in 1.263s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:26 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf Jul 08 03:30:26 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:27 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf" returned: 0 in 0.923s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dfa0f7-fb71-4f2a-9c8c-ce40a4b932cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a9536a-130b-42b7-b067-a0dc7985cddf', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2ab0cc-79ab-432e-8199-d3deb93dc01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Volume volume-00a9536a-130b-42b7-b067-a0dc7985cddf (00a9536a-130b-42b7-b067-a0dc7985cddf): created successfully Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2ab0cc-79ab-432e-8199-d3deb93dc01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Flow 'volume_create_manager' (9d385be7-3c30-4242-a524-16b109b3c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-34652b5e-e5ee-4b55-963f-238a232df2b2 tempest-VolumesTransfersV357Test-1914184922 None] Created volume successfully. Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Acquiring lock "cinder-00a9536a-130b-42b7-b067-a0dc7985cddf-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-00a9536a-130b-42b7-b067-a0dc7985cddf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Acquiring lock "cinder-quobyte-00a9536a-130b-42b7-b067-a0dc7985cddf" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-quobyte-00a9536a-130b-42b7-b067-a0dc7985cddf" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f794d7-9e85-455b-aa3f-22d4fb9eabc6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:28 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf Jul 08 03:30:28 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:28 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf" returned: 0 in 0.894s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:28 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf Jul 08 03:30:28 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:30 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-00a9536a-130b-42b7-b067-a0dc7985cddf" returned: 0 in 1.376s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-quobyte-00a9536a-130b-42b7-b067-a0dc7985cddf" released by "delete_volume" :: held 2.368s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Created reservations ['cc95c0e4-3b98-4c8f-bf0f-01bac46ef96f', 'e5da1b40-89bb-4c78-9fe4-7c1a84d35380', 'e47cb773-a74f-4406-973a-22156dd0f131', 'd3d7c7ac-e203-4532-83a5-383b400869e3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:30 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:30:30 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:31 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.052s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:31 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:30:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Deleted volume successfully. Jul 08 03:30:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9cee7e67-66eb-46d2-836d-44374fb7a507 tempest-VolumesTransfersV357Test-798925399 None] Lock "cinder-00a9536a-130b-42b7-b067-a0dc7985cddf-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:40 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=16,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Flow 'volume_create_manager' (c637eaf5-c019-463c-be64-f42112698780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bc7835-d0e0-413f-95cf-0fad88f79c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bc7835-d0e0-413f-95cf-0fad88f79c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-305383470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44edcf4e-619f-4e6d-87d1-ef296caedb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c855d0134b9c424ea93e10cfe232279a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:42Z,use_quota=True,user_id='57375c01abf9494badb9b957404d0e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4601398f-1432-478e-973a-95cbf3296273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4601398f-1432-478e-973a-95cbf3296273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec08322a-b515-482c-8bdc-93df825da196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:41 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:30:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec08322a-b515-482c-8bdc-93df825da196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44edcf4e-619f-4e6d-87d1-ef296caedb4f', 'volume_name': 'volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592f6473-dfbb-4c47-a721-f2a1dbc578f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592f6473-dfbb-4c47-a721-f2a1dbc578f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d420348b-3b09-4f6a-a4c6-1fbc13768cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:42 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Volume 44edcf4e-619f-4e6d-87d1-ef296caedb4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 03:30:42 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Trying to clone 44edcf4e-619f-4e6d-87d1-ef296caedb4f from image ad206503-c10d-4ca1-92a8-b1a38f579b05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:30:43 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:30:43 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Image download 20.69 MB at 20.69 MB/s Jul 08 03:30:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacbd841-452a-4e96-8dc6-ff938ecaefe5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:43 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD Jul 08 03:30:43 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:44 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD" returned: 0 in 0.932s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:44 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 is fetched for user 57375c01abf9494badb9b957404d0e8b. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:30:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1063f920-6c04-42eb-b3b1-b8e44ecc2885]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:45 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD Jul 08 03:30:45 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:45 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD" returned: 0 in 1.080s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-305383470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44edcf4e-619f-4e6d-87d1-ef296caedb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c855d0134b9c424ea93e10cfe232279a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:30:42Z,use_quota=True,user_id='57375c01abf9494badb9b957404d0e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Creating volume 44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:30:46 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:46 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 1073741824 Jul 08 03:30:46 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Acquiring lock "cinder-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "cinder-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Acquiring lock "cinder-quobyte-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "cinder-quobyte-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f0229-5a54-41ed-a4af-d7f76719ce38]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:47 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:30:47 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:47 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 Jul 08 03:30:47 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:47 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 1073741824" returned: 0 in 1.681s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:47 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:30:47 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:48 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.298s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:30:48 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5" returned: 0 in 1.520s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:48 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5 Jul 08 03:30:48 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:49 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 0 in 1.308s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] <== create_volume: return (3105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.114s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Attempting download of ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 44edcf4e-619f-4e6d-87d1-ef296caedb4f. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf743fd-f382-4cee-9748-28eca0f6ce97]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:49 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo Jul 08 03:30:49 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:49 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5" returned: 0 in 1.317s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "cinder-quobyte-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5" released by "delete_volume" :: held 2.929s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:49 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Created reservations ['fa26f484-603b-48eb-b07b-2169c0909954', 'a19ed7da-8222-47cd-8529-d5584332038b', '567a274a-8257-46e5-8a83-d9de82cbe526', '619015ca-1e8b-4bdd-8309-09413a88ce45'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:50 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:30:50 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:50 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo" returned: 0 in 1.470s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:50 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.946s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:50 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo Jul 08 03:30:50 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:30:50 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Deleted volume successfully. Jul 08 03:30:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4da798e0-207e-4d11-b5e7-967ed9a619b3 tempest-ServerRescueNegativeTestJSON-1113042786 None] Lock "cinder-383f56e8-bc4c-4f39-a2ad-fcf53ccbd0b5-delete_volume" released by "delete_volume" :: held 4.261s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:30:51 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo" returned: 1 in 1.020s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0p_dzbyo' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:30:51 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b77cb3-8843-4b66-96f7-e93c7937b14e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:51 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD Jul 08 03:30:51 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:52 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD" returned: 0 in 1.079s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:52 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] ad206503-c10d-4ca1-92a8-b1a38f579b05 was qcow2, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:30:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:52 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:30:52 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:56 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 0 in 4.032s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:56 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_ul6xl6r6devstack@QuobyteHD, size 112.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:30:56 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Converted 112.00 MB image at 27.76 MB/s Jul 08 03:30:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:56 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 1G Jul 08 03:30:56 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:57 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 1G" returned: 0 in 0.806s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85f6e44-a1e2-4a61-bfb5-e1752dbe4005]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:30:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:57 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:30:57 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:58 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 0 in 0.786s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:58 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:30:58 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:30:59 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 1 in 0.814s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Downloaded image ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 44edcf4e-619f-4e6d-87d1-ef296caedb4f successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 for user 57375c01abf9494badb9b957404d0e8b is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Marking volume 44edcf4e-619f-4e6d-87d1-ef296caedb4f as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Copying metadata from image ad206503-c10d-4ca1-92a8-b1a38f579b05 to 44edcf4e-619f-4e6d-87d1-ef296caedb4f. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Creating volume glance metadata for volume 44edcf4e-619f-4e6d-87d1-ef296caedb4f backed by image ad206503-c10d-4ca1-92a8-b1a38f579b05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d420348b-3b09-4f6a-a4c6-1fbc13768cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eafe0dc-eb68-4618-8eb7-d97edf59d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Volume volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f (44edcf4e-619f-4e6d-87d1-ef296caedb4f): created successfully Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eafe0dc-eb68-4618-8eb7-d97edf59d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Flow 'volume_create_manager' (c637eaf5-c019-463c-be64-f42112698780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8a863284-4230-42ba-8fdf-e05cce57fa9a tempest-VolumesExtendTest-731821988 None] Created volume successfully. Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Flow 'volume_create_manager' (55b1eda9-82a0-4d0b-8fce-5968e7a71c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7168e194-c0ba-4792-9f89-0d51cc869349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7168e194-c0ba-4792-9f89-0d51cc869349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-488408081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbab8a3-6884-4a6d-9972-eaf033efb50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44c4d36b43a40c19dcbc6f0d61c6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:00Z,use_quota=True,user_id='4ac0f13f4d5342af81ca7fcec9e58ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b470b69-a3dd-456b-8f33-551a0012c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b470b69-a3dd-456b-8f33-551a0012c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d51e20-c75a-4a31-a777-d2406b50a16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d51e20-c75a-4a31-a777-d2406b50a16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbab8a3-6884-4a6d-9972-eaf033efb50c', 'volume_name': 'volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d903e1c4-6511-4844-83ff-ec41bf1231ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d903e1c4-6511-4844-83ff-ec41bf1231ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac98986a-298c-461f-b504-cc8c0bd63249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:30:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Volume bfbab8a3-6884-4a6d-9972-eaf033efb50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c', 'volume_size': 1} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-488408081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbab8a3-6884-4a6d-9972-eaf033efb50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44c4d36b43a40c19dcbc6f0d61c6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:00Z,use_quota=True,user_id='4ac0f13f4d5342af81ca7fcec9e58ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Creating volume bfbab8a3-6884-4a6d-9972-eaf033efb50c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:30:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:30:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:30:59 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c 1073741824 Jul 08 03:30:59 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:00 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c 1073741824" returned: 0 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:00 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c Jul 08 03:31:00 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:01 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c" returned: 0 in 0.674s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.350s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac98986a-298c-461f-b504-cc8c0bd63249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4649fb20-352b-40db-9278-520cc704aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bcb08d-9fe9-49a9-acc1-c928bad8ab70]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Volume volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c (bfbab8a3-6884-4a6d-9972-eaf033efb50c): created successfully Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4649fb20-352b-40db-9278-520cc704aa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Flow 'volume_create_manager' (55b1eda9-82a0-4d0b-8fce-5968e7a71c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c9f8f3d1-00bb-4c95-9fcc-1e874d93ea5f tempest-AttachVolumeTestJSON-466969227 None] Created volume successfully. Jul 08 03:31:01 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:31:01 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:02 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:02 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:31:02 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:03 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 1 in 0.763s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 2G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f 2G" returned: 0 in 0.058s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.676s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:03 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-58f89bc8-ff68-41b7-b7bf-8dd303b26cec tempest-VolumesExtendTest-731821988 None] Extend volume completed successfully. Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-44edcf4e-619f-4e6d-87d1-ef296caedb4f-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Lock "cinder-44edcf4e-619f-4e6d-87d1-ef296caedb4f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-quobyte-44edcf4e-619f-4e6d-87d1-ef296caedb4f" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-44edcf4e-619f-4e6d-87d1-ef296caedb4f" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2265809-dc39-4eee-8cf1-7a1363ff3a50]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:03 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:31:03 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:04 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 0 in 0.876s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:04 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:31:04 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eede565d-fff7-41ab-9ed0-568b201915a6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:05 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c Jul 08 03:31:05 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:05 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 1 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:31:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:05 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f Jul 08 03:31:05 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:06 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c" returned: 0 in 0.845s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13deb507-0ce7-4a74-8417-87c07375bd57', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:31:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-668ddfc0-6b9c-4562-91d6-7abb2e191885 req-baf33f99-8f45-46ec-9171-527778d75d95 tempest-AttachVolumeTestJSON-466969227 None] attachment_update completed successfully. Jul 08 03:31:06 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-44edcf4e-619f-4e6d-87d1-ef296caedb4f" returned: 0 in 0.733s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-44edcf4e-619f-4e6d-87d1-ef296caedb4f" released by "delete_volume" :: held 2.574s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Created reservations ['e50b5717-3a9c-4dea-8396-618833ed254d', '2a798e90-ffa1-44a4-bf79-12d909609202', '516d11e3-bc92-4db0-99c6-2b456d48ccd7', '54633744-5c20-4a4a-84d5-e8380806ffce'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:06 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:31:06 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:07 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.754s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:31:07 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Deleted volume successfully. Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-78f317af-a953-4c70-b5a5-ff18f3d6ea9b tempest-VolumesExtendTest-731821988 None] Lock "cinder-44edcf4e-619f-4e6d-87d1-ef296caedb4f-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Flow 'volume_create_manager' (38d938b5-8110-4a1d-97b9-afc397e0c185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7022868d-e258-46a8-8b40-d6a7051096c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7022868d-e258-46a8-8b40-d6a7051096c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1810767083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5f4405-9920-4188-aacf-b22ba5bab966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c855d0134b9c424ea93e10cfe232279a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:07Z,use_quota=True,user_id='57375c01abf9494badb9b957404d0e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24452670-3df8-4470-8f8a-d480084a1672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24452670-3df8-4470-8f8a-d480084a1672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f430ad3-68af-4866-b569-22f31c9f3cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f430ad3-68af-4866-b569-22f31c9f3cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5f4405-9920-4188-aacf-b22ba5bab966', 'volume_name': 'volume-4c5f4405-9920-4188-aacf-b22ba5bab966', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb401d3c-2064-404f-afcf-aecec1013857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb401d3c-2064-404f-afcf-aecec1013857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138df14f-d270-4870-990e-b580bfc18fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Volume 4c5f4405-9920-4188-aacf-b22ba5bab966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5f4405-9920-4188-aacf-b22ba5bab966', 'volume_size': 1} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1810767083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5f4405-9920-4188-aacf-b22ba5bab966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c855d0134b9c424ea93e10cfe232279a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:07Z,use_quota=True,user_id='57375c01abf9494badb9b957404d0e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Creating volume 4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:31:07 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:31:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:07 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 1073741824 Jul 08 03:31:07 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:08 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 1073741824" returned: 0 in 0.816s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:08 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 Jul 08 03:31:08 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:09 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966" returned: 0 in 0.646s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138df14f-d270-4870-990e-b580bfc18fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5f4405-9920-4188-aacf-b22ba5bab966', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70495496-2dc6-4bc3-8c19-2be6f59a586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:09 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Volume volume-4c5f4405-9920-4188-aacf-b22ba5bab966 (4c5f4405-9920-4188-aacf-b22ba5bab966): created successfully Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70495496-2dc6-4bc3-8c19-2be6f59a586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Flow 'volume_create_manager' (38d938b5-8110-4a1d-97b9-afc397e0c185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:09 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-777d00aa-d71f-440e-a516-2292363ecd04 tempest-VolumesExtendTest-731821988 None] Created volume successfully. Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Creating offline snapshot 79ec102d-9004-4521-9c65-e435fc8dd315 of volume 4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[78394f32-f7ef-438a-85d7-2609481c2693]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:09 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 Jul 08 03:31:09 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Flow 'volume_create_manager' (77eae4a8-afde-40e7-97a4-0e332ea217df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c51925-38ad-4906-b0ff-83e57ef6eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c51925-38ad-4906-b0ff-83e57ef6eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1158226966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8a8551-3efb-4e6d-ae55-e1220295acba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641f6e7240d4ebfa0ab4ffa547711a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:10Z,use_quota=True,user_id='191e9a7ec37347fc8516af11d11c5533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f3bbf5-e08b-4395-8832-7ec43e15975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f3bbf5-e08b-4395-8832-7ec43e15975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7cde61-13d5-458c-b839-254487d2b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7cde61-13d5-458c-b839-254487d2b38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8a8551-3efb-4e6d-ae55-e1220295acba', 'volume_name': 'volume-2b8a8551-3efb-4e6d-ae55-e1220295acba', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d20e94c-34a0-45a5-b16a-324872a5727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d20e94c-34a0-45a5-b16a-324872a5727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6be8a1-a7ca-4040-9287-25e6988e0d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:10 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Volume 2b8a8551-3efb-4e6d-ae55-e1220295acba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8a8551-3efb-4e6d-ae55-e1220295acba', 'volume_size': 1} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:10 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966" returned: 0 in 0.907s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:10 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 1G Jul 08 03:31:10 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:11 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 1G" returned: 0 in 0.904s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5f4405-9920-4188-aacf-b22ba5bab966 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:11 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5f4405-9920-4188-aacf-b22ba5bab966 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 Jul 08 03:31:11 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:11 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:31:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Flow 'volume_create_manager' (c5a86eb8-ebc5-4b0d-b32d-86e8af132427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcef2a4e-bdc6-422f-b38c-b05c33e0299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcef2a4e-bdc6-422f-b38c-b05c33e0299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-341256413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afed4bce-766e-4ae4-b85b-04d769e1438a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44c4d36b43a40c19dcbc6f0d61c6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:12Z,use_quota=True,user_id='4ac0f13f4d5342af81ca7fcec9e58ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8532b4e-69fb-43e0-8fba-683598cf5b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8532b4e-69fb-43e0-8fba-683598cf5b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d9bec-3a03-40e3-9d57-0dcae9f846db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d9bec-3a03-40e3-9d57-0dcae9f846db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afed4bce-766e-4ae4-b85b-04d769e1438a', 'volume_name': 'volume-afed4bce-766e-4ae4-b85b-04d769e1438a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c94e4d6-32b5-4c43-ac50-8c85a6bd548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c94e4d6-32b5-4c43-ac50-8c85a6bd548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c28d6dc-7854-4501-9a9c-fa73e817c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:12 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Volume afed4bce-766e-4ae4-b85b-04d769e1438a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afed4bce-766e-4ae4-b85b-04d769e1438a', 'volume_size': 1} Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:12 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5f4405-9920-4188-aacf-b22ba5bab966 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:12 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 is being set with open permissions: ugo+rw Jul 08 03:31:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:12 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 Jul 08 03:31:12 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:13 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315" returned: 0 in 0.728s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:13 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info Jul 08 03:31:13 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:13 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info" returned: 0 in 0.697s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:13 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info is being set with open permissions: ugo+rw Jul 08 03:31:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:13 devstack sudo[92316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info Jul 08 03:31:13 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:14 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.info" returned: 0 in 0.671s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.787s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1158226966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8a8551-3efb-4e6d-ae55-e1220295acba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641f6e7240d4ebfa0ab4ffa547711a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:10Z,use_quota=True,user_id='191e9a7ec37347fc8516af11d11c5533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Creating volume 2b8a8551-3efb-4e6d-ae55-e1220295acba {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:31:14 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:31:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:14 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba 1073741824 Jul 08 03:31:14 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-350f14eb-85b6-47b6-8fe8-767ad8637959 tempest-VolumesExtendTest-731821988 None] Create snapshot completed successfully Jul 08 03:31:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:15 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba 1073741824" returned: 0 in 0.870s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:15 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba Jul 08 03:31:15 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:16 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.020s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-341256413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afed4bce-766e-4ae4-b85b-04d769e1438a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44c4d36b43a40c19dcbc6f0d61c6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:31:12Z,use_quota=True,user_id='4ac0f13f4d5342af81ca7fcec9e58ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Creating volume afed4bce-766e-4ae4-b85b-04d769e1438a {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:31:16 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6be8a1-a7ca-4040-9287-25e6988e0d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8a8551-3efb-4e6d-ae55-e1220295acba', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb27bd5-2a72-4d31-b170-098d246fc478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:16 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a 1073741824 Jul 08 03:31:16 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Volume volume-2b8a8551-3efb-4e6d-ae55-e1220295acba (2b8a8551-3efb-4e6d-ae55-e1220295acba): created successfully Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb27bd5-2a72-4d31-b170-098d246fc478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Flow 'volume_create_manager' (77eae4a8-afde-40e7-97a4-0e332ea217df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0a62774b-0760-4715-b4ad-403d086899dc tempest-AttachVolumeShelveTestJSON-1863648443 None] Created volume successfully. Jul 08 03:31:17 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a 1073741824" returned: 0 in 0.961s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:17 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a Jul 08 03:31:17 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:17 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a" returned: 0 in 0.716s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.723s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973eda2-f516-482a-8a9f-bf1cc1bf7313]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c28d6dc-7854-4501-9a9c-fa73e817c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afed4bce-766e-4ae4-b85b-04d769e1438a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000420ee-ffe6-4149-b9b5-c09bda873abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:31:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Volume volume-afed4bce-766e-4ae4-b85b-04d769e1438a (afed4bce-766e-4ae4-b85b-04d769e1438a): created successfully Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000420ee-ffe6-4149-b9b5-c09bda873abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:31:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Flow 'volume_create_manager' (c5a86eb8-ebc5-4b0d-b32d-86e8af132427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:31:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-52f2811a-659d-41d0-8cad-81049c4a6c24 tempest-AttachVolumeTestJSON-466969227 None] Created volume successfully. Jul 08 03:31:18 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 Jul 08 03:31:18 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:18 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966" returned: 0 in 0.979s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 2G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 2G" returned: 0 in 0.126s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.150s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f98214b0-8222-452b-bd6b-a7b6dd6fc956 tempest-VolumesExtendTest-731821988 None] Extend volume completed successfully. Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-79ec102d-9004-4521-9c65-e435fc8dd315-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Lock "cinder-79ec102d-9004-4521-9c65-e435fc8dd315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-quobyte-4c5f4405-9920-4188-aacf-b22ba5bab966" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-4c5f4405-9920-4188-aacf-b22ba5bab966" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-quobyte-79ec102d-9004-4521-9c65-e435fc8dd315" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-79ec102d-9004-4521-9c65-e435fc8dd315" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Deleting offline snapshot 79ec102d-9004-4521-9c65-e435fc8dd315 of volume 4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] snapshot_file for this snap is: volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b29a98-9598-4717-bcbc-264b9d94ba37]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:19 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 Jul 08 03:31:19 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:20 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315" returned: 0 in 0.878s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5f4405-9920-4188-aacf-b22ba5bab966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:31:20 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0257b2d-547c-4e2f-8f44-110b46edb963]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:20 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 Jul 08 03:31:20 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05679d-9674-46dd-b4e0-1623ad3f4442]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:21 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966" returned: 0 in 1.038s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:21 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 Jul 08 03:31:21 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:21 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a Jul 08 03:31:21 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:22 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a" returned: 0 in 1.084s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.116s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-afed4bce-766e-4ae4-b85b-04d769e1438a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e3d5d11-b785-4001-9afc-198bc4c20264', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:31:22 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315" returned: 0 in 1.103s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:22 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315 Jul 08 03:31:22 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-8e928935-06c4-491b-ab4b-2241f82fc33c req-39d93020-6e48-47cb-8925-effdf3b81a6a tempest-AttachVolumeTestJSON-466969227 None] attachment_update completed successfully. Jul 08 03:31:23 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966.79ec102d-9004-4521-9c65-e435fc8dd315" returned: 0 in 0.761s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-79ec102d-9004-4521-9c65-e435fc8dd315" released by "_delete_snapshot" :: held 3.917s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-4c5f4405-9920-4188-aacf-b22ba5bab966" released by "delete_snapshot" :: held 3.941s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:23 devstack cinder-volume[86294]: WARNING cinder.quota [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:31:23 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Created reservations ['70245ee0-0d87-4bb0-87ef-3d17dadb1884', '7cd390e6-b977-4bb5-bc38-cba6c0ba1ab9', '17b85361-f847-4921-ae14-0e50fd245351', '8511be47-98ff-4ba2-8b76-1badf920acbb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:31:23 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Delete snapshot completed successfully. Jul 08 03:31:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-81926e4f-c9c8-40d5-9e19-79f35c3509c7 tempest-VolumesExtendTest-731821988 None] Lock "cinder-79ec102d-9004-4521-9c65-e435fc8dd315-delete_snapshot" released by "delete_snapshot" :: held 4.175s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-4c5f4405-9920-4188-aacf-b22ba5bab966-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Lock "cinder-4c5f4405-9920-4188-aacf-b22ba5bab966-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Acquiring lock "cinder-quobyte-4c5f4405-9920-4188-aacf-b22ba5bab966" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-4c5f4405-9920-4188-aacf-b22ba5bab966" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:24 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[340d8cf2-5d45-427d-b1c6-c1f830f9345e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:24 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 Jul 08 03:31:24 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:25 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966" returned: 0 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:25 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966 Jul 08 03:31:25 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:25 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c5f4405-9920-4188-aacf-b22ba5bab966" returned: 0 in 0.795s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Lock "cinder-quobyte-4c5f4405-9920-4188-aacf-b22ba5bab966" released by "delete_volume" :: held 1.790s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Created reservations ['9896aee7-99bc-4dc4-b7cb-289d09201587', '3b396de5-f183-42c2-b9ea-cf8bb65c27e3', 'de0273c9-7334-40c4-9883-f92753f0f3d6', '0a883a88-1626-44fd-acbe-1736fe54d900'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:26 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:31:26 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:27 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.889s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:27 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:31:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Deleted volume successfully. Jul 08 03:31:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b19c4ba-7eee-4c24-9090-6dc44da9b786 tempest-VolumesExtendTest-731821988 None] Lock "cinder-4c5f4405-9920-4188-aacf-b22ba5bab966-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-1546993f-c99b-40c2-98c0-48681a3402f3 req-af07e58e-f86e-443c-a94c-d1936ef97296 tempest-AttachVolumeTestJSON-466969227 None] Terminate volume connection completed successfully. Jul 08 03:31:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-1546993f-c99b-40c2-98c0-48681a3402f3 req-af07e58e-f86e-443c-a94c-d1936ef97296 tempest-AttachVolumeTestJSON-466969227 None] Deleting attachment 13deb507-0ce7-4a74-8417-87c07375bd57. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:31:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-3d5fdd92-c439-4a85-a890-a858c7babe45 req-c92a388b-e428-41da-a8f2-10a19a5e2d88 tempest-AttachVolumeTestJSON-466969227 None] Terminate volume connection completed successfully. Jul 08 03:31:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-3d5fdd92-c439-4a85-a890-a858c7babe45 req-c92a388b-e428-41da-a8f2-10a19a5e2d88 tempest-AttachVolumeTestJSON-466969227 None] Deleting attachment 2e3d5d11-b785-4001-9afc-198bc4c20264. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:31:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-a1e046c3-8e1e-46bb-81e3-b629c5562174 req-d597837f-b69d-4bab-a415-8e2d7a42ef04 tempest-AttachVolumeShelveTestJSON-1863648443 None] No connector for attachment 07621335-680b-432b-a234-b6be52a966eb; skipping storage backend terminate_connection call. {{(pid=86294) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 03:31:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-a1e046c3-8e1e-46bb-81e3-b629c5562174 req-d597837f-b69d-4bab-a415-8e2d7a42ef04 tempest-AttachVolumeShelveTestJSON-1863648443 None] Deleting attachment 07621335-680b-432b-a234-b6be52a966eb. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:31:44 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=62,cinder:UPDATE=53,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:31:44 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=58,cinder:SELECT=55,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:47 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:31:47 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:47 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:31:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:31:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:31:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:31:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "cinder-afed4bce-766e-4ae4-b85b-04d769e1438a-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-afed4bce-766e-4ae4-b85b-04d769e1438a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "cinder-quobyte-afed4bce-766e-4ae4-b85b-04d769e1438a" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-quobyte-afed4bce-766e-4ae4-b85b-04d769e1438a" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa73237-a448-439c-8925-c806d116fef8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:50 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a Jul 08 03:31:50 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:51 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a" returned: 0 in 1.354s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:51 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a Jul 08 03:31:51 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:52 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-afed4bce-766e-4ae4-b85b-04d769e1438a" returned: 0 in 1.144s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-quobyte-afed4bce-766e-4ae4-b85b-04d769e1438a" released by "delete_volume" :: held 2.564s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Created reservations ['70d3395d-791d-4f74-ba20-c8c7a0d07c4f', '880f4b71-1b17-44d6-b5b1-f29f0717d7d8', '343a496c-4687-4fbb-8075-497ab854aacf', '42790c5f-bc8e-4d2b-a96b-394c76000b85'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:52 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:31:52 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "cinder-bfbab8a3-6884-4a6d-9972-eaf033efb50c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-bfbab8a3-6884-4a6d-9972-eaf033efb50c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "cinder-quobyte-bfbab8a3-6884-4a6d-9972-eaf033efb50c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-quobyte-bfbab8a3-6884-4a6d-9972-eaf033efb50c" acquired by "delete_volume" :: waited 0.055s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[01266959-a826-41d3-8365-9806fb4672c8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:54 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c Jul 08 03:31:54 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:54 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.366s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:54 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:31:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Deleted volume successfully. Jul 08 03:31:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-52712808-2416-4b3b-bb42-c6897d4dc882 tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-afed4bce-766e-4ae4-b85b-04d769e1438a-delete_volume" released by "delete_volume" :: held 4.401s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:54 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c" returned: 0 in 1.064s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:54 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c Jul 08 03:31:54 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:56 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bfbab8a3-6884-4a6d-9972-eaf033efb50c" returned: 0 in 1.548s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-quobyte-bfbab8a3-6884-4a6d-9972-eaf033efb50c" released by "delete_volume" :: held 2.736s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Created reservations ['aa3bed17-b6f1-4e04-bd72-f81e6e872465', '2b6e5393-6366-48ec-acac-dec67868f906', 'd2380957-1b26-4fb1-9ba5-8b38aa674178', '151f696a-81d8-46aa-8105-45a568268b83'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:31:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:56 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:31:56 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "cinder-3f575189-4827-4563-9b91-3db5e6170308-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-3f575189-4827-4563-9b91-3db5e6170308-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "cinder-quobyte-3f575189-4827-4563-9b91-3db5e6170308" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:31:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-quobyte-3f575189-4827-4563-9b91-3db5e6170308" acquired by "delete_volume" :: waited 0.043s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:31:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d62b41-7680-42a6-a444-83e305fc6b6c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:31:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:57 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 Jul 08 03:31:57 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:58 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.290s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:58 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:31:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Deleted volume successfully. Jul 08 03:31:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43dc4d73-7280-464e-8ddc-5b212eaf53be tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-bfbab8a3-6884-4a6d-9972-eaf033efb50c-delete_volume" released by "delete_volume" :: held 4.533s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:58 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308" returned: 0 in 1.366s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:31:58 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308 Jul 08 03:31:58 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:31:59 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jul 08 03:31:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f575189-4827-4563-9b91-3db5e6170308" returned: 0 in 0.907s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:31:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-quobyte-3f575189-4827-4563-9b91-3db5e6170308" released by "delete_volume" :: held 2.347s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:31:59 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Created reservations ['ff76bddf-5f4b-48b8-8310-2d64216cdfec', 'b96b3a45-a10e-4cd9-bce9-85c5478d02a6', '6b4927e8-9dce-4168-bd76-b5ab14ae7d33', '3fe799f6-a346-403a-8c3e-c0838649e151'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:00 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:32:00 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:01 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.385s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:01 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:32:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Deleted volume successfully. Jul 08 03:32:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-694f995d-8fa0-4796-bba8-276c1d7aa71d tempest-AttachVolumeTestJSON-466969227 None] Lock "cinder-3f575189-4827-4563-9b91-3db5e6170308-delete_volume" released by "delete_volume" :: held 4.263s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:10 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:32:11 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=14,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:32:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-880fed40-7247-490f-96c6-2532e5028a41 tempest-BackendsCapabilitiesAdminTestsJSON-1518677796 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86294) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 03:32:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0ebde913-f40f-4d76-a226-2e26fdcb9453 tempest-BackendsCapabilitiesAdminTestsJSON-1518677796 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86294) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Flow 'volume_create_manager' (8d141d55-7744-4082-9ba3-9cd0b13d3661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7d3652-a293-4cd6-95df-14775316a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7d3652-a293-4cd6-95df-14775316a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-238500928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1eb3de9-93af-43f3-8445-56d339ff55e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f8786122e443e3b3a34f9b26ba656f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:16Z,use_quota=True,user_id='9a80ca5619fb43f1a623c76e3e943068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb923be-e1eb-4bf2-8008-499d29bb3b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb923be-e1eb-4bf2-8008-499d29bb3b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86007c82-4b4f-41d1-a2ef-12df33ae0297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86007c82-4b4f-41d1-a2ef-12df33ae0297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1eb3de9-93af-43f3-8445-56d339ff55e1', 'volume_name': 'volume-c1eb3de9-93af-43f3-8445-56d339ff55e1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe267ea5-5686-4120-a5d0-71067d0a4c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe267ea5-5686-4120-a5d0-71067d0a4c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41fdad4-0c2a-4b6f-bca2-c0c7e35b5b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Volume c1eb3de9-93af-43f3-8445-56d339ff55e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1eb3de9-93af-43f3-8445-56d339ff55e1', 'volume_size': 1} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-238500928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1eb3de9-93af-43f3-8445-56d339ff55e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2f8786122e443e3b3a34f9b26ba656f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:16Z,use_quota=True,user_id='9a80ca5619fb43f1a623c76e3e943068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Creating volume c1eb3de9-93af-43f3-8445-56d339ff55e1 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:32:16 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:16 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 1073741824 Jul 08 03:32:16 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Flow 'volume_create_manager' (82569b5f-361d-48ce-9204-3696301d2555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1b32be-9d44-4cfb-9b32-b27db000ac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1b32be-9d44-4cfb-9b32-b27db000ac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1442510626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f01325-b26e-4880-84ab-a70aa9b32e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc67961694f0459aa724e2df0053e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:17Z,use_quota=True,user_id='4d903f02cb304be68b24218c9337293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bce051-d62f-4a0d-8a4a-9a6c067fcd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bce051-d62f-4a0d-8a4a-9a6c067fcd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a1f679-8196-4ef9-af10-96704ee2e2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a1f679-8196-4ef9-af10-96704ee2e2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f01325-b26e-4880-84ab-a70aa9b32e50', 'volume_name': 'volume-d8f01325-b26e-4880-84ab-a70aa9b32e50', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbeee0e-901e-4606-baab-f76fdf6f91ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbeee0e-901e-4606-baab-f76fdf6f91ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a450fee-5633-44e8-9d3c-729ad02d76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Volume d8f01325-b26e-4880-84ab-a70aa9b32e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f01325-b26e-4880-84ab-a70aa9b32e50', 'volume_size': 1} Jul 08 03:32:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:17 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 1073741824" returned: 0 in 1.160s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:17 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 Jul 08 03:32:17 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:18 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1" returned: 0 in 0.768s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1442510626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f01325-b26e-4880-84ab-a70aa9b32e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc67961694f0459aa724e2df0053e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:17Z,use_quota=True,user_id='4d903f02cb304be68b24218c9337293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Creating volume d8f01325-b26e-4880-84ab-a70aa9b32e50 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:32:18 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41fdad4-0c2a-4b6f-bca2-c0c7e35b5b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1eb3de9-93af-43f3-8445-56d339ff55e1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a795543-1451-4e1d-8ac7-e70aa7eea064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:18 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 1073741824 Jul 08 03:32:18 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:18 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Volume volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 (c1eb3de9-93af-43f3-8445-56d339ff55e1): created successfully Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a795543-1451-4e1d-8ac7-e70aa7eea064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Flow 'volume_create_manager' (8d141d55-7744-4082-9ba3-9cd0b13d3661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:18 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0aa4ef61-bdaa-4101-902c-3137e665ecb8 tempest-TestMinimumBasicScenario-1146939635 None] Created volume successfully. Jul 08 03:32:19 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 1073741824" returned: 0 in 0.885s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:19 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 Jul 08 03:32:19 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-59becdb1-f279-4ad2-bb4c-a0b8348c728e tempest-GroupSnapshotsV319Test-2044527799 None] Group tempest-GroupSnapshotsV319Test-Group-2068355007: creating Jul 08 03:32:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-59becdb1-f279-4ad2-bb4c-a0b8348c728e tempest-GroupSnapshotsV319Test-2044527799 None] Group tempest-GroupSnapshotsV319Test-Group-2068355007: created successfully Jul 08 03:32:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-59becdb1-f279-4ad2-bb4c-a0b8348c728e tempest-GroupSnapshotsV319Test-2044527799 None] Create group completed successfully. Jul 08 03:32:19 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50" returned: 0 in 0.945s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a450fee-5633-44e8-9d3c-729ad02d76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f01325-b26e-4880-84ab-a70aa9b32e50', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0371d959-84d3-4924-9092-4b086647224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Volume volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 (d8f01325-b26e-4880-84ab-a70aa9b32e50): created successfully Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0371d959-84d3-4924-9092-4b086647224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Flow 'volume_create_manager' (82569b5f-361d-48ce-9204-3696301d2555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b4381ec9-7616-4f8d-86e3-ce578850618c tempest-AttachVolumeNegativeTest-974566903 None] Created volume successfully. Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Flow 'volume_create_manager' (d0be0cdc-0e68-4b3e-a2fb-fe8f53e88902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e7cf56-8cac-44f0-b594-4cdd46012a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e7cf56-8cac-44f0-b594-4cdd46012a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858943705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4805a91-3b7f-4209-997e-0b08ba6f62a2,host='devstack@QuobyteHD#QuobyteHD',id=ef9b8f11-731e-4c29-a497-c258bdfd2eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062ec34b01c4f4ba4fac2f7f1172e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:21Z,use_quota=True,user_id='e229a2b371804ff487350949fce50fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce2ec32a-ddd2-41ab-af4e-7d3067d3d58e),volume_type_id=ce2ec32a-ddd2-41ab-af4e-7d3067d3d58e)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dda4301-1dab-4e74-b4ff-749844298754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dda4301-1dab-4e74-b4ff-749844298754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781a8128-55ad-42b2-a499-b762ca8684fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781a8128-55ad-42b2-a499-b762ca8684fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9b8f11-731e-4c29-a497-c258bdfd2eb7', 'volume_name': 'volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb4d17d-3734-4cbb-afde-d70da1d9a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb4d17d-3734-4cbb-afde-d70da1d9a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105823bf-463c-4ee1-bb93-df66f6de0b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:21 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Volume ef9b8f11-731e-4c29-a497-c258bdfd2eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7', 'volume_size': 1} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4805a91-3b7f-4209-997e-0b08ba6f62a2,created_at=2026-07-08T01:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858943705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4805a91-3b7f-4209-997e-0b08ba6f62a2,host='devstack@QuobyteHD#QuobyteHD',id=ef9b8f11-731e-4c29-a497-c258bdfd2eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062ec34b01c4f4ba4fac2f7f1172e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:21Z,use_quota=True,user_id='e229a2b371804ff487350949fce50fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce2ec32a-ddd2-41ab-af4e-7d3067d3d58e),volume_type_id=ce2ec32a-ddd2-41ab-af4e-7d3067d3d58e)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Creating volume ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:32:21 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:32:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:21 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 1073741824 Jul 08 03:32:21 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:22 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 1073741824" returned: 0 in 0.878s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:22 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 Jul 08 03:32:22 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:22 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" returned: 0 in 0.769s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.221s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105823bf-463c-4ee1-bb93-df66f6de0b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b8d14b-e68c-432c-b6d2-a7d637906a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed092b2-bde1-4b6a-b36a-3ef000d45660]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Volume volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 (ef9b8f11-731e-4c29-a497-c258bdfd2eb7): created successfully Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b8d14b-e68c-432c-b6d2-a7d637906a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Flow 'volume_create_manager' (d0be0cdc-0e68-4b3e-a2fb-fe8f53e88902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5621ddec-f65d-4a9c-acb4-affa77a0cd8f tempest-GroupSnapshotsV319Test-2044527799 None] Created volume successfully. Jul 08 03:32:23 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 Jul 08 03:32:23 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:23 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] GroupSnapshot 542c7ed5-2cfe-44c9-b00e-6b98ff995faf: creating. Jul 08 03:32:23 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1" returned: 0 in 1.042s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Group snapshot 542c7ed5-2cfe-44c9-b00e-6b98ff995faf: creating. {{(pid=86294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-c1eb3de9-93af-43f3-8445-56d339ff55e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '214feef1-db8c-4b1e-b0eb-1d422ab3f4fa', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Creating offline snapshot babda0da-b1a2-4ee1-ba17-e556c9c0b84c of volume ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e132c1b-4a68-436f-9d45-ed33e461f96f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-194aa3e4-90c7-454e-8a5d-247e0360d9c2 req-618867d7-b7c8-4220-ad2f-3afea869299b tempest-TestMinimumBasicScenario-1146939635 None] attachment_update completed successfully. Jul 08 03:32:24 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 Jul 08 03:32:24 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:25 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" returned: 0 in 1.119s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:25 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c 1G Jul 08 03:32:25 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:26 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c 1G" returned: 0 in 1.154s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:26 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c Jul 08 03:32:26 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:27 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c" returned: 0 in 0.776s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:27 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:32:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:27 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c Jul 08 03:32:27 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:27 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:27 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info Jul 08 03:32:27 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:28 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info" returned: 0 in 0.734s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:28 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:32:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:28 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info Jul 08 03:32:28 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:29 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.info" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.235s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.917s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4241d4-816d-40ca-823a-f3a8cbe19f3b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e3960acc-1237-4eba-90ff-7557696b9191 tempest-GroupSnapshotsV319Test-2044527799 None] group_snapshot 542c7ed5-2cfe-44c9-b00e-6b98ff995faf: created successfully Jul 08 03:32:29 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 Jul 08 03:32:29 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] group_snapshot 542c7ed5-2cfe-44c9-b00e-6b98ff995faf: deleting Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] group_snapshot 542c7ed5-2cfe-44c9-b00e-6b98ff995faf: deleting {{(pid=86294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 03:32:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "cinder-quobyte-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Lock "cinder-quobyte-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "cinder-quobyte-babda0da-b1a2-4ee1-ba17-e556c9c0b84c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Lock "cinder-quobyte-babda0da-b1a2-4ee1-ba17-e556c9c0b84c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Deleting offline snapshot babda0da-b1a2-4ee1-ba17-e556c9c0b84c of volume ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] snapshot_file for this snap is: volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c339d6-094d-47ba-b242-947b8ddc4441]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:30 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50" returned: 0 in 0.933s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.960s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:30 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c Jul 08 03:32:30 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-d8f01325-b26e-4880-84ab-a70aa9b32e50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20597313-a376-4186-9398-23f1039a91ea', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:32:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-0c33dac4-7ed2-41ac-942f-a18d5ebba537 req-16d6ed29-d125-4d3b-a2f2-c5302ca2dd46 tempest-AttachVolumeNegativeTest-974566903 None] attachment_update completed successfully. Jul 08 03:32:30 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c" returned: 0 in 0.834s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfb8743-76aa-4be3-ae74-58c40098d1d4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:31 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 Jul 08 03:32:31 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Acquiring lock "cinder-2b8a8551-3efb-4e6d-ae55-e1220295acba-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "cinder-2b8a8551-3efb-4e6d-ae55-e1220295acba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:31 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" returned: 0 in 0.917s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:31 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c Jul 08 03:32:31 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Acquiring lock "cinder-quobyte-2b8a8551-3efb-4e6d-ae55-e1220295acba" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "cinder-quobyte-2b8a8551-3efb-4e6d-ae55-e1220295acba" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda1bbfc-ef93-4e6b-aa21-f02fbb51d2d0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:32 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba Jul 08 03:32:32 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:32 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba" returned: 0 in 0.841s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:32 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c" returned: 0 in 0.938s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:32 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba Jul 08 03:32:32 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:32 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c Jul 08 03:32:32 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:33 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7.babda0da-b1a2-4ee1-ba17-e556c9c0b84c" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:33 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2b8a8551-3efb-4e6d-ae55-e1220295acba" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Lock "cinder-quobyte-babda0da-b1a2-4ee1-ba17-e556c9c0b84c" released by "_delete_snapshot" :: held 3.585s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "cinder-quobyte-2b8a8551-3efb-4e6d-ae55-e1220295acba" released by "delete_volume" :: held 1.701s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Lock "cinder-quobyte-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" released by "delete_snapshot" :: held 3.619s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Created reservations ['6300ff5f-1a59-48ea-8ef3-87f0822ebf62', '54b51abd-5910-49b3-9b88-2e11272a3a8f', 'f15ab1da-3051-4c94-aebb-bcfced0cb037', '35ae5b42-445a-4a77-86fd-eb82e518c90b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:33 devstack cinder-volume[86294]: WARNING cinder.quota [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-663450034 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-663450034, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:32:33 devstack cinder-volume[86294]: WARNING cinder.quota [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-663450034 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-663450034, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] Created reservations ['a6a73fb5-4fd0-482b-886c-b48550dc5e25', '0326a47a-f8e6-4da6-8979-f205abae36c8', '4befa725-0f83-4f99-a743-00f545643d5d', '8eb90288-dd54-4781-a56c-4d93251aae31'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:33 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:32:33 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-02dd474d-9c72-4ab9-916e-bf50cd6b5d1b tempest-GroupSnapshotsV319Test-2044527799 None] group_snapshot 542c7ed5-2cfe-44c9-b00e-6b98ff995faf: deleted successfully Jul 08 03:32:34 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.878s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:32:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Deleted volume successfully. Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b8d4e70a-208d-49dc-aac7-f21a32073b8c tempest-AttachVolumeShelveTestJSON-1863648443 None] Lock "cinder-2b8a8551-3efb-4e6d-ae55-e1220295acba-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "cinder-quobyte-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "cinder-quobyte-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[128fe07a-b3eb-4470-a867-7221c2d46ea1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:35 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 Jul 08 03:32:35 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:35 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" returned: 0 in 0.924s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:35 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7 Jul 08 03:32:35 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:36 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" returned: 0 in 0.881s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "cinder-quobyte-ef9b8f11-731e-4c29-a497-c258bdfd2eb7" released by "delete_volume" :: held 1.901s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Created reservations ['9df59a0b-a6b9-4112-b901-871f99957efb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:36 devstack cinder-volume[86294]: WARNING cinder.quota [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-663450034 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-663450034, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:32:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Created reservations ['286d21bb-af2b-4dc2-b088-92714f70450e', 'c6aef060-d740-4c77-ba10-bded22b296bf', '2b53d4fd-724b-4fce-b714-3010b19200cc', '2724c79e-cb47-45fd-a07f-6d397f51c7b1'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:37 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:32:37 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:37 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.809s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:37 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:32:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a5d7415d-4447-40b2-9a5c-b95372630c3f tempest-GroupSnapshotsV319Test-2044527799 None] Delete group completed successfully. Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Flow 'volume_create_manager' (fef85950-582a-4272-879d-d5a7e8cfda71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bd3f20-3dbb-47ff-a48c-ba57e5102625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bd3f20-3dbb-47ff-a48c-ba57e5102625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-674063743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de849c6-787a-411e-82b5-b8a8e4901a29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cb4023d89584ff68ae5c65f6947f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:43Z,use_quota=True,user_id='0085ec85a85448cf99140d4e0fa4176d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8751ccb-e45b-4cbf-a71e-da2947e85316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8751ccb-e45b-4cbf-a71e-da2947e85316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747e46e1-226b-4158-9a55-d1113246d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747e46e1-226b-4158-9a55-d1113246d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de849c6-787a-411e-82b5-b8a8e4901a29', 'volume_name': 'volume-4de849c6-787a-411e-82b5-b8a8e4901a29', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9ee2fe-bd08-4c5b-89a0-a1db9d76492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9ee2fe-bd08-4c5b-89a0-a1db9d76492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbb308b-784a-4b19-b859-15ec702b1edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:43 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Volume 4de849c6-787a-411e-82b5-b8a8e4901a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de849c6-787a-411e-82b5-b8a8e4901a29', 'volume_size': 1} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-674063743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de849c6-787a-411e-82b5-b8a8e4901a29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cb4023d89584ff68ae5c65f6947f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:43Z,use_quota=True,user_id='0085ec85a85448cf99140d4e0fa4176d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Creating volume 4de849c6-787a-411e-82b5-b8a8e4901a29 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:32:43 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:32:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:43 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 1073741824 Jul 08 03:32:43 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:44 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 1073741824" returned: 0 in 0.894s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:44 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 Jul 08 03:32:44 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:44 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29" returned: 0 in 0.713s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbb308b-784a-4b19-b859-15ec702b1edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de849c6-787a-411e-82b5-b8a8e4901a29', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a33a6f-783a-4b2f-82fe-d58ba06e3b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:44 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Volume volume-4de849c6-787a-411e-82b5-b8a8e4901a29 (4de849c6-787a-411e-82b5-b8a8e4901a29): created successfully Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a33a6f-783a-4b2f-82fe-d58ba06e3b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Flow 'volume_create_manager' (fef85950-582a-4272-879d-d5a7e8cfda71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1dfb8356-4809-470b-a3e5-aec6d574ed66 tempest-VolumesTestJSON-152068729 None] Created volume successfully. Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Flow 'volume_create_manager' (0ea92abe-daf5-499b-9f64-6b07d978911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec94965-8cf1-415e-9148-a92a6ae04b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec94965-8cf1-415e-9148-a92a6ae04b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1696999066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec2f492-e900-4690-b0e4-4c1d3735dbf4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cb4023d89584ff68ae5c65f6947f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:46Z,use_quota=True,user_id='0085ec85a85448cf99140d4e0fa4176d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22873ebf-cc9d-4076-ad58-5ed5adf27155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22873ebf-cc9d-4076-ad58-5ed5adf27155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00673d67-04db-427c-b0f7-0ba3e2a14b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00673d67-04db-427c-b0f7-0ba3e2a14b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec2f492-e900-4690-b0e4-4c1d3735dbf4', 'volume_name': 'volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed75d9b-9505-4376-ad38-02199b84acf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed75d9b-9505-4376-ad38-02199b84acf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e8168d-0f26-4c20-93b5-1162465cb5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:45 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Volume 0ec2f492-e900-4690-b0e4-4c1d3735dbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4', 'volume_size': 1} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1696999066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec2f492-e900-4690-b0e4-4c1d3735dbf4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cb4023d89584ff68ae5c65f6947f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:46Z,use_quota=True,user_id='0085ec85a85448cf99140d4e0fa4176d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Creating volume 0ec2f492-e900-4690-b0e4-4c1d3735dbf4 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:32:45 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:32:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:46 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 1073741824 Jul 08 03:32:46 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:47 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:32:47 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:47 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 1073741824" returned: 0 in 1.212s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:47 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 Jul 08 03:32:47 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:48 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4" returned: 0 in 0.997s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e8168d-0f26-4c20-93b5-1162465cb5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f553f804-c4b9-4811-bb7a-a3eff1a145dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:48 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Volume volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 (0ec2f492-e900-4690-b0e4-4c1d3735dbf4): created successfully Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f553f804-c4b9-4811-bb7a-a3eff1a145dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Flow 'volume_create_manager' (0ea92abe-daf5-499b-9f64-6b07d978911d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.361s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:32:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:32:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4f16e5ca-f675-4c09-ab42-853677ce1889 tempest-VolumesTestJSON-152068729 None] Created volume successfully. Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Flow 'volume_create_manager' (b3d0f1de-d80e-46df-b74f-fdea46ec3310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d187e2a-486d-44c6-af38-36ba301c31f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d187e2a-486d-44c6-af38-36ba301c31f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1421637168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637abf04-7959-4cb5-a7e1-aa6630d8f5f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cb4023d89584ff68ae5c65f6947f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:50Z,use_quota=True,user_id='0085ec85a85448cf99140d4e0fa4176d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a1546c-c067-4584-9d2c-234d45a3ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a1546c-c067-4584-9d2c-234d45a3ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c2bd4c-5def-4c78-a833-622d0854bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c2bd4c-5def-4c78-a833-622d0854bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637abf04-7959-4cb5-a7e1-aa6630d8f5f5', 'volume_name': 'volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bfa1bb-b094-49d5-9dc9-a8d720e8832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bfa1bb-b094-49d5-9dc9-a8d720e8832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed927269-a1b9-4db9-a5f0-cacd5bbf1fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:50 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Volume 637abf04-7959-4cb5-a7e1-aa6630d8f5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5', 'volume_size': 1} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1421637168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637abf04-7959-4cb5-a7e1-aa6630d8f5f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cb4023d89584ff68ae5c65f6947f7d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:32:50Z,use_quota=True,user_id='0085ec85a85448cf99140d4e0fa4176d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Creating volume 637abf04-7959-4cb5-a7e1-aa6630d8f5f5 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:32:50 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:32:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:50 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 1073741824 Jul 08 03:32:50 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-912b1478-8a08-4dc5-95a6-b902a3a02dfe tempest-GroupsV320Test-404754202 None] Group tempest-GroupsV320Test-Group-1281831102: creating Jul 08 03:32:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-912b1478-8a08-4dc5-95a6-b902a3a02dfe tempest-GroupsV320Test-404754202 None] Group tempest-GroupsV320Test-Group-1281831102: created successfully Jul 08 03:32:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-912b1478-8a08-4dc5-95a6-b902a3a02dfe tempest-GroupsV320Test-404754202 None] Create group completed successfully. Jul 08 03:32:51 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 1073741824" returned: 0 in 1.184s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:51 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 Jul 08 03:32:51 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:52 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5" returned: 0 in 1.072s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed927269-a1b9-4db9-a5f0-cacd5bbf1fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6dfa38-850c-4d0a-a37c-fefffe90b84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:32:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Volume volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 (637abf04-7959-4cb5-a7e1-aa6630d8f5f5): created successfully Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6dfa38-850c-4d0a-a37c-fefffe90b84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Flow 'volume_create_manager' (b3d0f1de-d80e-46df-b74f-fdea46ec3310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:32:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0e41bc0d-8b98-46df-b4aa-5f1beb7a813e tempest-VolumesTestJSON-152068729 None] Created volume successfully. Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Created reservations ['f56da827-52e0-40f5-a604-393c92ce81f7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:52 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:32:52 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:53 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.751s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:53 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:32:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0c792414-5e47-490e-85cd-bb6db0e5af0d tempest-GroupsV320Test-404754202 None] Delete group completed successfully. Jul 08 03:32:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Acquiring lock "cinder-637abf04-7959-4cb5-a7e1-aa6630d8f5f5-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Lock "cinder-637abf04-7959-4cb5-a7e1-aa6630d8f5f5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Acquiring lock "cinder-quobyte-637abf04-7959-4cb5-a7e1-aa6630d8f5f5" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Lock "cinder-quobyte-637abf04-7959-4cb5-a7e1-aa6630d8f5f5" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4565974-e22c-4fca-8a15-33809cf94eb6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:54 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 Jul 08 03:32:54 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:55 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5" returned: 0 in 1.356s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:55 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5 Jul 08 03:32:55 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:57 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-637abf04-7959-4cb5-a7e1-aa6630d8f5f5" returned: 0 in 1.429s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Lock "cinder-quobyte-637abf04-7959-4cb5-a7e1-aa6630d8f5f5" released by "delete_volume" :: held 2.853s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Created reservations ['5f480b25-df90-4aa8-8fcd-a788c3d8618c', 'b67a55ed-99b2-460c-afff-1fe7a72a18d8', '2fa3e732-233a-4c0f-8b6d-3ec3d2a03798', '00bd80c4-3322-4f58-9393-e5a0eaa964e9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:32:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:57 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:32:57 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Acquiring lock "cinder-0ec2f492-e900-4690-b0e4-4c1d3735dbf4-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Lock "cinder-0ec2f492-e900-4690-b0e4-4c1d3735dbf4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Acquiring lock "cinder-quobyte-0ec2f492-e900-4690-b0e4-4c1d3735dbf4" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Lock "cinder-quobyte-0ec2f492-e900-4690-b0e4-4c1d3735dbf4" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af6a811-26e4-4121-8f6e-639becfa1a61]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:32:58 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 Jul 08 03:32:58 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:32:58 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.172s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:32:58 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:32:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Deleted volume successfully. Jul 08 03:32:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d05ae635-916b-408c-beeb-8207222127bb tempest-VolumesTestJSON-152068729 None] Lock "cinder-637abf04-7959-4cb5-a7e1-aa6630d8f5f5-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:00 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4" returned: 0 in 1.886s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:00 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4 Jul 08 03:33:00 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:01 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0ec2f492-e900-4690-b0e4-4c1d3735dbf4" returned: 0 in 0.885s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Lock "cinder-quobyte-0ec2f492-e900-4690-b0e4-4c1d3735dbf4" released by "delete_volume" :: held 2.853s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Created reservations ['e434acad-58b6-4558-9c49-fee3b431ea3d', 'ed7a6aff-ad10-4785-bd79-b9e23ad1b234', 'f2e922cf-cace-4910-8107-9c4a002608f2', '431e5373-ef0a-441f-8b34-742ef89099e0'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:01 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:01 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Acquiring lock "cinder-4de849c6-787a-411e-82b5-b8a8e4901a29-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Lock "cinder-4de849c6-787a-411e-82b5-b8a8e4901a29-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Acquiring lock "cinder-quobyte-4de849c6-787a-411e-82b5-b8a8e4901a29" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Lock "cinder-quobyte-4de849c6-787a-411e-82b5-b8a8e4901a29" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3454e4e6-083f-4877-b2a8-2f6016776f9f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:02 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 Jul 08 03:33:02 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:02 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.073s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:33:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Deleted volume successfully. Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d510cd14-a82a-4881-ad94-1abefe247db0 tempest-VolumesTestJSON-152068729 None] Lock "cinder-0ec2f492-e900-4690-b0e4-4c1d3735dbf4-delete_volume" released by "delete_volume" :: held 4.314s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:02 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29" returned: 0 in 0.965s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:03 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29 Jul 08 03:33:03 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Flow 'volume_create_manager' (cb26cb95-8a42-46e7-8bf3-52fd309c352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd30633-c844-41a7-8b9e-fef3cb56e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd30633-c844-41a7-8b9e-fef3cb56e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-346052488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccda659-3c36-454e-bc04-0e22c97dca63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685843f8b24e4f128afac0e1eb478483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:03Z,use_quota=True,user_id='6f2d1668bd31468da3b111365aea1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be2215e-b686-482c-a89e-22ab23651ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be2215e-b686-482c-a89e-22ab23651ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3e71e4-e100-4e91-91b5-c03c7c9beb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3e71e4-e100-4e91-91b5-c03c7c9beb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccda659-3c36-454e-bc04-0e22c97dca63', 'volume_name': 'volume-7ccda659-3c36-454e-bc04-0e22c97dca63', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d370b7ac-f7ef-4fd0-aa7a-09fb50a06ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d370b7ac-f7ef-4fd0-aa7a-09fb50a06ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8d7cd4-a492-470a-9d85-eb5208352137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:03 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Volume 7ccda659-3c36-454e-bc04-0e22c97dca63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccda659-3c36-454e-bc04-0e22c97dca63', 'volume_size': 1} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-346052488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccda659-3c36-454e-bc04-0e22c97dca63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685843f8b24e4f128afac0e1eb478483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:03Z,use_quota=True,user_id='6f2d1668bd31468da3b111365aea1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Creating volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:33:03 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:03 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 1073741824 Jul 08 03:33:03 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:03 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4de849c6-787a-411e-82b5-b8a8e4901a29" returned: 0 in 0.732s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Lock "cinder-quobyte-4de849c6-787a-411e-82b5-b8a8e4901a29" released by "delete_volume" :: held 1.765s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Created reservations ['0f5d2b1a-e225-48dd-a3fb-50122c92ccdf', '1b4d6009-a7a0-4ca5-a6a2-cff5125ecbce', '735cdcfc-841e-42a3-9969-fcd04b9fedd8', 'f03de04d-285a-48fe-a577-53edecc0648f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:03 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:03 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:04 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 1073741824" returned: 0 in 0.842s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:04 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 Jul 08 03:33:04 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:04 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.821s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:04 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:33:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Deleted volume successfully. Jul 08 03:33:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b703dac3-5697-4013-bab4-2145b4770707 tempest-VolumesTestJSON-152068729 None] Lock "cinder-4de849c6-787a-411e-82b5-b8a8e4901a29-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:05 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8d7cd4-a492-470a-9d85-eb5208352137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccda659-3c36-454e-bc04-0e22c97dca63', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c437e-2a07-4153-823c-6ab1f11d5593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:05 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Volume volume-7ccda659-3c36-454e-bc04-0e22c97dca63 (7ccda659-3c36-454e-bc04-0e22c97dca63): created successfully Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c437e-2a07-4153-823c-6ab1f11d5593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Flow 'volume_create_manager' (cb26cb95-8a42-46e7-8bf3-52fd309c352e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:05 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5089c4ae-8c3a-49a9-9eb2-336491971abe tempest-SnapshotsActionsTest-268767209 None] Created volume successfully. Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Creating offline snapshot b48637d0-7fed-427d-a6fb-2916942087d1 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[683127bf-7fb1-4d30-8244-5133c5222833]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:05 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 Jul 08 03:33:05 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:06 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63" returned: 0 in 0.890s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:06 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 1G Jul 08 03:33:06 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:07 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 1G" returned: 0 in 0.889s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:07 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:07 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:08 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.803s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:08 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 is being set with open permissions: ugo+rw Jul 08 03:33:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:08 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:08 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1d23062d-b2be-4034-8055-401666db2fa3 tempest-GroupSnapshotsTest-720221876 None] Group tempest-GroupSnapshotsTest-Group-1596592104: creating Jul 08 03:33:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1d23062d-b2be-4034-8055-401666db2fa3 tempest-GroupSnapshotsTest-720221876 None] Group tempest-GroupSnapshotsTest-Group-1596592104: created successfully Jul 08 03:33:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1d23062d-b2be-4034-8055-401666db2fa3 tempest-GroupSnapshotsTest-720221876 None] Create group completed successfully. Jul 08 03:33:09 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:09 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info Jul 08 03:33:09 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:09 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info" returned: 0 in 0.674s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:09 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info is being set with open permissions: ugo+rw Jul 08 03:33:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:09 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info Jul 08 03:33:09 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=81,cinder:SELECT=74,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (5549db53-9327-43f8-9607-07a094e9f2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e302d3a-c1f7-427d-a9dd-e1be836812ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e302d3a-c1f7-427d-a9dd-e1be836812ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-254129769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4319ba9c-2a5a-47dc-8081-b013600eade3,host='devstack@QuobyteHD#QuobyteHD',id=4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:10Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b37e86c-bc3f-4980-854d-2f2e993031dd),volume_type_id=3b37e86c-bc3f-4980-854d-2f2e993031dd)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0033ae-8105-4843-abc0-47b3a07d4941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0033ae-8105-4843-abc0-47b3a07d4941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62b04fd-8e1b-43c9-96da-a8ec1b237373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62b04fd-8e1b-43c9-96da-a8ec1b237373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028', 'volume_name': 'volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e19977-79be-4bb7-a5c6-acae8791c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e19977-79be-4bb7-a5c6-acae8791c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:10 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0afedeb-2c5a-4632-b50b-7a68cf4c839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:10 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Volume 4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028', 'volume_size': 1} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.info" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.826s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4319ba9c-2a5a-47dc-8081-b013600eade3,created_at=2026-07-08T01:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-254129769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4319ba9c-2a5a-47dc-8081-b013600eade3,host='devstack@QuobyteHD#QuobyteHD',id=4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:10Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b37e86c-bc3f-4980-854d-2f2e993031dd),volume_type_id=3b37e86c-bc3f-4980-854d-2f2e993031dd)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Creating volume 4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:33:10 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:33:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:10 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 1073741824 Jul 08 03:33:10 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:10 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3c3cc270-3be9-4dc1-9962-0b908b69fb8b tempest-SnapshotsActionsTest-268767209 None] Create snapshot completed successfully Jul 08 03:33:11 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 1073741824" returned: 0 in 0.858s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:11 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:11 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:11 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.608s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Creating offline snapshot 6bc4a8d6-5881-461e-a36e-91d5814a091b of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0afedeb-2c5a-4632-b50b-7a68cf4c839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0e0c1f-bfc2-44d1-a44a-64ae8cd208e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda22d8d-3330-4dc6-90af-6469ca96f8f6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=88,cinder:UPDATE=86,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:33:12 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Volume volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 (4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028): created successfully Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0e0c1f-bfc2-44d1-a44a-64ae8cd208e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (5549db53-9327-43f8-9607-07a094e9f2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c845ed10-0266-46f2-8e43-75e906593c55 tempest-GroupSnapshotsTest-720221876 None] Created volume successfully. Jul 08 03:33:12 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:12 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:12 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.844s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:12 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b 1G Jul 08 03:33:12 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] GroupSnapshot a6ed65df-844a-4d05-b6b3-92f457e9d746: creating. Jul 08 03:33:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Group snapshot a6ed65df-844a-4d05-b6b3-92f457e9d746: creating. {{(pid=86294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 03:33:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:13 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b 1G" returned: 0 in 0.975s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:13 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b Jul 08 03:33:13 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:14 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b" returned: 0 in 0.707s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:14 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b is being set with open permissions: ugo+rw Jul 08 03:33:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:14 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b Jul 08 03:33:14 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:15 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.336s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.311s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-cf9fb47f-3783-4f1d-a8d0-050e7250fca3 req-6d4bcf59-762a-43b2-a803-b0487250390b tempest-TestMinimumBasicScenario-1146939635 None] Terminate volume connection completed successfully. Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-cf9fb47f-3783-4f1d-a8d0-050e7250fca3 req-6d4bcf59-762a-43b2-a803-b0487250390b tempest-TestMinimumBasicScenario-1146939635 None] Deleting attachment 214feef1-db8c-4b1e-b0eb-1d422ab3f4fa. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:33:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b47230e7-0189-49f3-a96f-d66192806817 tempest-SnapshotsActionsTest-268767209 None] Create snapshot completed successfully Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Creating offline snapshot 0649f913-01be-4cc8-8836-20702ae709c9 of volume 4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125bf72-bbf4-4d68-8e23-5dfe5dee089a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:15 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:15 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-6bc4a8d6-5881-461e-a36e-91d5814a091b-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-6bc4a8d6-5881-461e-a36e-91d5814a091b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-6bc4a8d6-5881-461e-a36e-91d5814a091b" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-6bc4a8d6-5881-461e-a36e-91d5814a091b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Deleting offline snapshot 6bc4a8d6-5881-461e-a36e-91d5814a091b of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] snapshot_file for this snap is: volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e509a8-5582-4710-95ea-23ca4cb1d16c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:15 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b Jul 08 03:33:15 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:16 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.910s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:16 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 1G Jul 08 03:33:16 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:16 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b" returned: 0 in 0.832s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb48b1-ed30-40b7-ab51-7e439d2c594c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:16 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:16 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:17 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 1G" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:17 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 Jul 08 03:33:17 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Acquiring lock "cinder-c1eb3de9-93af-43f3-8445-56d339ff55e1-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Lock "cinder-c1eb3de9-93af-43f3-8445-56d339ff55e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Acquiring lock "cinder-quobyte-c1eb3de9-93af-43f3-8445-56d339ff55e1" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:17 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Lock "cinder-quobyte-c1eb3de9-93af-43f3-8445-56d339ff55e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.816s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4615955a-8711-4945-81d6-db6e46778d6b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:17 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b Jul 08 03:33:17 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:17 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 Jul 08 03:33:17 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:17 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9" returned: 0 in 0.740s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:17 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:33:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:17 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 Jul 08 03:33:17 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:18 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b" returned: 0 in 0.759s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:18 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b Jul 08 03:33:18 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:18 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:18 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1 Jul 08 03:33:18 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:18 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:18 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info Jul 08 03:33:18 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:18 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.6bc4a8d6-5881-461e-a36e-91d5814a091b" returned: 0 in 0.659s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-6bc4a8d6-5881-461e-a36e-91d5814a091b" released by "_delete_snapshot" :: held 3.165s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" released by "delete_snapshot" :: held 3.194s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:18 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c1eb3de9-93af-43f3-8445-56d339ff55e1" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Lock "cinder-quobyte-c1eb3de9-93af-43f3-8445-56d339ff55e1" released by "delete_volume" :: held 1.506s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Created reservations ['77ad72bc-1141-4f5c-9102-27ed5f33270b', '8c1ab0a7-b1cf-4fee-a6b7-88f7de9663c5', 'c5940b61-2cf5-4681-8246-97bab8e0fed0', 'f92593c0-22d5-40a7-9bad-02fe1a6b53a1'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Created reservations ['b3879c32-5bb1-4b12-8007-931fe58f096d', '781e1c6a-6b32-4490-8f94-84e356dd2540', 'ad620509-f68d-4f0e-8dc8-42d4319e7e56', '1954d1d4-50fc-4450-825a-73ec045decd2'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Delete snapshot completed successfully. Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-929a4a43-4101-43d6-bd0a-13dbc3d6e3d3 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-6bc4a8d6-5881-461e-a36e-91d5814a091b-delete_snapshot" released by "delete_snapshot" :: held 3.381s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:19 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:19 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:19 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info" returned: 0 in 0.668s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:19 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:19 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info Jul 08 03:33:19 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:19 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:33:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Deleted volume successfully. Jul 08 03:33:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-99bf15a5-b938-4539-afcc-7b1b9b6e7e53 tempest-TestMinimumBasicScenario-1146939635 None] Lock "cinder-c1eb3de9-93af-43f3-8445-56d339ff55e1-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:20 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.info" returned: 0 in 0.768s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.764s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7e9d7e75-e004-48c3-8f04-c7f6b8722f08 tempest-GroupSnapshotsTest-720221876 None] group_snapshot a6ed65df-844a-4d05-b6b3-92f457e9d746: created successfully Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Creating offline snapshot a289faea-3d3e-47c0-bc6a-06613f89cdd4 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1bb7f3-26e2-40f9-a16f-ddfafc5d3c20]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:20 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:20 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:21 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:21 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 1G Jul 08 03:33:21 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:22 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 1G" returned: 0 in 1.207s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:22 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 Jul 08 03:33:22 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:23 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4" returned: 0 in 0.933s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:23 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 is being set with open permissions: ugo+rw Jul 08 03:33:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:23 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 Jul 08 03:33:23 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:24 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4" returned: 0 in 0.695s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.569s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-0649f913-01be-4cc8-8836-20702ae709c9-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-0649f913-01be-4cc8-8836-20702ae709c9-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Creating volume b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 from snapshot 0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e78b2877-047b-46a6-b816-652c4ee9dd1c tempest-SnapshotsActionsTest-268767209 None] Create snapshot completed successfully Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] snapshot: 0649f913-01be-4cc8-8836-20702ae709c9, volume: b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[43819c80-8410-4e22-afac-10758396e43f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:24 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 Jul 08 03:33:24 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-a289faea-3d3e-47c0-bc6a-06613f89cdd4-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-a289faea-3d3e-47c0-bc6a-06613f89cdd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-a289faea-3d3e-47c0-bc6a-06613f89cdd4" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-a289faea-3d3e-47c0-bc6a-06613f89cdd4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Deleting offline snapshot a289faea-3d3e-47c0-bc6a-06613f89cdd4 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] snapshot_file for this snap is: volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223dddb-673c-4c26-9b07-6632f4b3a5e4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:24 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 Jul 08 03:33:24 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:25 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9" returned: 0 in 0.826s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ce242c-19ee-4645-9b30-739c239ea931]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:25 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:25 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:25 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb80437b-80fa-4fd7-815e-cefc1e617712]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:25 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:25 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:25 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:33:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:25 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 Jul 08 03:33:25 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:26 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.875s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:26 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 Jul 08 03:33:26 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:28 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4" returned: 0 in 2.288s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:28 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4 Jul 08 03:33:28 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:30 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.a289faea-3d3e-47c0-bc6a-06613f89cdd4" returned: 0 in 1.264s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-a289faea-3d3e-47c0-bc6a-06613f89cdd4" released by "_delete_snapshot" :: held 5.385s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" released by "delete_snapshot" :: held 5.429s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:30 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Created reservations ['4e1bfcef-caf1-43b7-8a26-0a98e5da95e0', 'e88eb2f2-f834-4eaa-a06f-b54f779b4ec2', 'aa3a2434-5756-4fce-b4bf-18499b513c63', '0610a479-ac6f-4e67-ba91-83d4c763d7e7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Delete snapshot completed successfully. Jul 08 03:33:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-46f80952-8a79-4612-97a8-3a94567bed50 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-a289faea-3d3e-47c0-bc6a-06613f89cdd4-delete_snapshot" released by "delete_snapshot" :: held 5.838s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:32 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" returned: 0 in 6.286s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52a6629-c6b1-43a7-b120-ea5635d5d634]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:32 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:32 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-0c805f41-4ff7-4095-887a-cfc5a38ea7ab req-5f60d4f2-7227-47c2-b681-466a4c3c7ed9 tempest-AttachVolumeNegativeTest-974566903 None] Terminate volume connection completed successfully. Jul 08 03:33:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-0c805f41-4ff7-4095-887a-cfc5a38ea7ab req-5f60d4f2-7227-47c2-b681-466a4c3c7ed9 tempest-AttachVolumeNegativeTest-974566903 None] Deleting attachment 20597313-a376-4186-9398-23f1039a91ea. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:33:33 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.944s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:33:33 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Converted 1024.00 MB image at 162.87 MB/s Jul 08 03:33:33 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:33 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 Jul 08 03:33:33 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:33 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" returned: 0 in 0.672s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" released by "_copy_volume_from_snapshot" :: held 9.590s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-0649f913-01be-4cc8-8836-20702ae709c9-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" released by "_create_volume_from_snapshot" :: held 9.633s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.661s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.735s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Creating offline snapshot 43cd879d-1ae3-43bf-a56d-322a66528f65 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c5f04-4dfe-475f-b5c0-17d665af8f03]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:34 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:34 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d2121c4f-4b69-4630-8cda-269b79cd1add tempest-GroupSnapshotsTest-720221876 None] Create group from source-snapshot-a6ed65df-844a-4d05-b6b3-92f457e9d746 completed successfully. Jul 08 03:33:34 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.932s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:34 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 1G Jul 08 03:33:34 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0864744-4d3b-4821-a4b2-350f413891b6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:35 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 Jul 08 03:33:35 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:35 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 1G" returned: 0 in 1.083s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:35 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 Jul 08 03:33:35 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:36 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" returned: 0 in 0.874s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:36 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9 Jul 08 03:33:36 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:36 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65" returned: 0 in 0.997s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:36 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 is being set with open permissions: ugo+rw Jul 08 03:33:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:36 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 Jul 08 03:33:36 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:37 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" returned: 0 in 0.822s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-b3fdf8ae-e5fe-41c1-b7d5-a1984b4b39c9" released by "delete_volume" :: held 1.749s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Created reservations ['f7dc3275-91d2-4c0b-8079-a4e943aea8a5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:37 devstack cinder-volume[86294]: WARNING cinder.quota [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1375913028 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1375913028, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:33:37 devstack cinder-volume[86294]: WARNING cinder.quota [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1375913028 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1375913028, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Created reservations ['ffcd8839-4317-4a62-b7bd-3cc9f1532a84', '93b1de46-bdd5-4a7a-889b-a82d292eeadd', 'cccd115d-9a3d-4421-be8f-1aaffda3febb', '8a992647-b85c-4dbd-8a40-cc6f919cffed'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:37 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65" returned: 0 in 0.828s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:37 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:37 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.985s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-347a1623-1687-4e56-b4dd-fafeae96bf94 tempest-SnapshotsActionsTest-268767209 None] Create snapshot completed successfully Jul 08 03:33:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] group_snapshot a6ed65df-844a-4d05-b6b3-92f457e9d746: deleting Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] group_snapshot a6ed65df-844a-4d05-b6b3-92f457e9d746: deleting {{(pid=86294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-0649f913-01be-4cc8-8836-20702ae709c9" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-0649f913-01be-4cc8-8836-20702ae709c9" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Deleting offline snapshot 0649f913-01be-4cc8-8836-20702ae709c9 of volume 4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] snapshot_file for this snap is: volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af785e-8e0f-4866-846a-d9fdb856385b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:38 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 Jul 08 03:33:38 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-43cd879d-1ae3-43bf-a56d-322a66528f65-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-43cd879d-1ae3-43bf-a56d-322a66528f65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-43cd879d-1ae3-43bf-a56d-322a66528f65" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-43cd879d-1ae3-43bf-a56d-322a66528f65" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Deleting offline snapshot 43cd879d-1ae3-43bf-a56d-322a66528f65 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:33:38 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] snapshot_file for this snap is: volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.030s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:33:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-23627094-6dd2-4fc7-8b78-30739a848b1c tempest-GroupSnapshotsTest-720221876 None] Delete group completed successfully. Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5fa89b-9fa6-413b-b97c-d690e82f8ffa]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:38 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 Jul 08 03:33:38 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:39 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9" returned: 0 in 1.011s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e108d5-62a8-4684-92a6-c67869f24b44]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:39 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:39 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:39 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65" returned: 0 in 0.939s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5639590-d4ad-41f1-87b7-c9cbe60580c0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:39 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:39 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:40 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.894s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:40 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 Jul 08 03:33:40 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:40 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.885s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:40 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 Jul 08 03:33:40 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:41 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9" returned: 0 in 0.822s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:41 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9 Jul 08 03:33:41 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:41 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65" returned: 0 in 0.905s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:41 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65 Jul 08 03:33:41 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:41 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028.0649f913-01be-4cc8-8836-20702ae709c9" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-0649f913-01be-4cc8-8836-20702ae709c9" released by "_delete_snapshot" :: held 3.667s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" released by "delete_snapshot" :: held 3.720s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:42 devstack cinder-volume[86294]: WARNING cinder.quota [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1375913028 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1375913028, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:33:42 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] Created reservations ['db33d28c-56ed-4432-938e-d97b31fcb680', 'bbd5eaab-3395-4b19-8cc2-a3f7b403732f', 'dbac0389-c9df-4552-9328-2a8080a7a631', '9204d8c6-ed02-4a98-a694-a8064f258563'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a06de2d0-5ab4-4b65-990b-0548600ee2a1 tempest-GroupSnapshotsTest-720221876 None] group_snapshot a6ed65df-844a-4d05-b6b3-92f457e9d746: deleted successfully Jul 08 03:33:42 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.43cd879d-1ae3-43bf-a56d-322a66528f65" returned: 0 in 0.759s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-43cd879d-1ae3-43bf-a56d-322a66528f65" released by "_delete_snapshot" :: held 3.633s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" released by "delete_snapshot" :: held 3.658s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:42 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Created reservations ['1850e6d6-8908-4345-804c-23a4747151ba', 'ee979780-93b2-4111-9554-3b269485ce02', 'e4200723-3c1f-490a-9da0-3b7f888113ec', '0ada391c-aa3f-43ee-be2d-09586463dd3a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Delete snapshot completed successfully. Jul 08 03:33:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9b676e1-1fbe-4007-a455-073291c3d6d9 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-43cd879d-1ae3-43bf-a56d-322a66528f65-delete_snapshot" released by "delete_snapshot" :: held 3.805s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b0ac8-0e89-49b7-8537-0f8cda1aedf2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Creating offline snapshot 58ca2d12-c754-48d1-a266-2ed678418582 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:43 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:43 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c17f71-0567-4a9e-badc-55c22d9b88e0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:43 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:43 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:44 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.907s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:44 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028 Jul 08 03:33:44 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:44 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 1.064s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:44 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 1G Jul 08 03:33:44 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:44 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" returned: 0 in 0.689s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-4d4bc5a9-b6bf-4e14-9c45-fb3bfbc98028" released by "delete_volume" :: held 1.707s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Created reservations ['d412e3b9-da67-463b-8349-f55a27093612'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:45 devstack cinder-volume[86294]: WARNING cinder.db.api [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1375913028'] Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Created reservations ['41957141-20a7-4235-b5d2-de281e7acaab', 'b7312727-0638-4bf2-acd4-7a3b4ecee71f', '7b50c55f-3f46-4936-8ce8-66373d5a1547', '617fa9ab-29c4-49a0-9314-9169465966e1'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:45 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:45 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:45 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 1G" returned: 0 in 1.050s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:45 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 Jul 08 03:33:45 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:46 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.769s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:33:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f36aada7-fe5c-4f29-b8bc-f33917d187d7 tempest-GroupSnapshotsTest-720221876 None] Delete group completed successfully. Jul 08 03:33:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2e781877-cb34-4342-9267-7a8c2447d7a5 tempest-GroupSnapshotsTest-720221876 None] Group tempest-GroupSnapshotsTest-Group-1179684579: creating Jul 08 03:33:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2e781877-cb34-4342-9267-7a8c2447d7a5 tempest-GroupSnapshotsTest-720221876 None] Group tempest-GroupSnapshotsTest-Group-1179684579: created successfully Jul 08 03:33:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2e781877-cb34-4342-9267-7a8c2447d7a5 tempest-GroupSnapshotsTest-720221876 None] Create group completed successfully. Jul 08 03:33:46 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582" returned: 0 in 0.984s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:46 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 is being set with open permissions: ugo+rw Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:46 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 Jul 08 03:33:46 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:47 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:47 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:47 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582" returned: 0 in 0.697s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.915s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-64a38cc3-35d3-4a88-8862-3027df8661fb tempest-SnapshotsActionsTest-268767209 None] Create snapshot completed successfully Jul 08 03:33:47 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.763s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:33:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (3cb953c5-6396-4848-aab4-206822dd580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4376ca1-6d95-488f-8037-3b4935c79e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4376ca1-6d95-488f-8037-3b4935c79e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498557630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a870cf6-46ec-43cb-8b2b-fbf0d7f5410a,host='devstack@QuobyteHD#QuobyteHD',id=ab451d18-b9fa-43b5-8f1e-efd6662a03fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:48Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a91d5fd-250e-42d2-8098-4b93f1f53a88),volume_type_id=3a91d5fd-250e-42d2-8098-4b93f1f53a88)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a018da83-d46c-40dc-a0cc-a8e50fb5417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a018da83-d46c-40dc-a0cc-a8e50fb5417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e22235-28f8-4a2d-9671-3dda6da95153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e22235-28f8-4a2d-9671-3dda6da95153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab451d18-b9fa-43b5-8f1e-efd6662a03fd', 'volume_name': 'volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95add796-99b9-4e53-ab14-dd406fd3db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95add796-99b9-4e53-ab14-dd406fd3db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad30d7c5-d11b-41f8-80e4-f45b6143a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Volume ab451d18-b9fa-43b5-8f1e-efd6662a03fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd', 'volume_size': 1} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a870cf6-46ec-43cb-8b2b-fbf0d7f5410a,created_at=2026-07-08T01:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498557630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a870cf6-46ec-43cb-8b2b-fbf0d7f5410a,host='devstack@QuobyteHD#QuobyteHD',id=ab451d18-b9fa-43b5-8f1e-efd6662a03fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:48Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a91d5fd-250e-42d2-8098-4b93f1f53a88),volume_type_id=3a91d5fd-250e-42d2-8098-4b93f1f53a88)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Creating volume ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:33:48 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-58ca2d12-c754-48d1-a266-2ed678418582-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:48 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd 1073741824 Jul 08 03:33:48 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-58ca2d12-c754-48d1-a266-2ed678418582-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Flow 'volume_create_manager' (f7fd7215-c925-452b-abf3-a7677576ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83774b9b-2bf7-45b4-8395-7a9b0bdc8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Acquiring lock "cinder-quobyte-58ca2d12-c754-48d1-a266-2ed678418582" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83774b9b-2bf7-45b4-8395-7a9b0bdc8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dea593-6f93-4272-90d5-fde39477cf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1f3ee6fb8e45a49f23d77cece2cdd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:48Z,use_quota=True,user_id='dae675445367408ca200a0fd352da16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac41924-f423-456e-9b1c-af98cc83f5f3),volume_type_id=9ac41924-f423-456e-9b1c-af98cc83f5f3)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0508af30-6e2f-4fdb-bc06-90efac3df16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0508af30-6e2f-4fdb-bc06-90efac3df16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe08c562-fcfb-4160-bbd8-3ba378f5a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-58ca2d12-c754-48d1-a266-2ed678418582" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Deleting offline snapshot 58ca2d12-c754-48d1-a266-2ed678418582 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] snapshot_file for this snap is: volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1fd4b0-cbe8-4147-a608-76cde64f3191]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:48 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 Jul 08 03:33:48 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe08c562-fcfb-4160-bbd8-3ba378f5a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54dea593-6f93-4272-90d5-fde39477cf50', 'volume_name': 'volume-54dea593-6f93-4272-90d5-fde39477cf50', 'volume_size': 1, 'image_id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/478336aa-2286-46d6-8145-13fe79efb2e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1d1d8a29a2e0d23825024ff232ec4b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd1f3ee6fb8e45a49f23d77cece2cdd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2eb47425bca41622473064e1a779b300123bb92021405b5a180a8c56b57c2a342314a0beb894759fbf908340951e8549e908053bf11094a3a9a4c945302db06c', 'id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'created_at': datetime.datetime(2026, 7, 8, 1, 33, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 33, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/478336aa-2286-46d6-8145-13fe79efb2e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a950459-c49f-4f3a-89df-8a7603700fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a950459-c49f-4f3a-89df-8a7603700fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e0d37e-1448-42c7-9ea6-90c5671f01e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Volume 54dea593-6f93-4272-90d5-fde39477cf50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54dea593-6f93-4272-90d5-fde39477cf50', 'volume_size': 1, 'image_id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/478336aa-2286-46d6-8145-13fe79efb2e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1d1d8a29a2e0d23825024ff232ec4b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd1f3ee6fb8e45a49f23d77cece2cdd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2eb47425bca41622473064e1a779b300123bb92021405b5a180a8c56b57c2a342314a0beb894759fbf908340951e8549e908053bf11094a3a9a4c945302db06c', 'id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'created_at': datetime.datetime(2026, 7, 8, 1, 33, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 33, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/478336aa-2286-46d6-8145-13fe79efb2e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Trying to clone 54dea593-6f93-4272-90d5-fde39477cf50 from image 478336aa-2286-46d6-8145-13fe79efb2e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/478336aa-2286-46d6-8145-13fe79efb2e6', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:33:48 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Image download 0.00 MB at 0.00 MB/s Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[943bdb8a-5a35-4d63-868b-cc08683cc913]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:48 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD Jul 08 03:33:48 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:49 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd 1073741824" returned: 0 in 0.874s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:49 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd Jul 08 03:33:49 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:49 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582" returned: 0 in 0.914s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd05a9a-14bf-4d12-a483-563b61414aea]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:49 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:49 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:49 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:49 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD Jul 08 03:33:49 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:49 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" returned: 0 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad30d7c5-d11b-41f8-80e4-f45b6143a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2edcdff-1017-45eb-a7c7-51ae007f0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:49 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Volume volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd (ab451d18-b9fa-43b5-8f1e-efd6662a03fd): created successfully Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2edcdff-1017-45eb-a7c7-51ae007f0563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (3cb953c5-6396-4848-aab4-206822dd580c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c33f199a-449e-477c-8f2c-8d57685fea36 tempest-GroupSnapshotsTest-720221876 None] Created volume successfully. Jul 08 03:33:50 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:50 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 Jul 08 03:33:50 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:50 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD" returned: 1 in 0.778s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Temporary image 478336aa-2286-46d6-8145-13fe79efb2e6 is fetched for user dae675445367408ca200a0fd352da16e. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebb0c5-ec74-4140-8b57-baacff9cc6a7]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:50 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD Jul 08 03:33:50 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:50 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582" returned: 0 in 0.829s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:50 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582 Jul 08 03:33:50 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (1e08003a-2451-4914-abd8-1e7714e91da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ac617d-dfe3-4194-8a48-430ed53279a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ac617d-dfe3-4194-8a48-430ed53279a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1696363232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a870cf6-46ec-43cb-8b2b-fbf0d7f5410a,host='devstack@QuobyteHD#QuobyteHD',id=cf73d299-830f-4a1e-b4c3-be516a0dc83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:51Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a91d5fd-250e-42d2-8098-4b93f1f53a88),volume_type_id=3a91d5fd-250e-42d2-8098-4b93f1f53a88)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b775e235-2dff-4106-84e6-b4380c152e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b775e235-2dff-4106-84e6-b4380c152e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9c313f-ccf0-4e83-8807-6a10a0acf031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9c313f-ccf0-4e83-8807-6a10a0acf031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf73d299-830f-4a1e-b4c3-be516a0dc83c', 'volume_name': 'volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bf9ad4-8753-483f-b501-59ee35c62aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bf9ad4-8753-483f-b501-59ee35c62aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39eb8e8c-c2e1-4063-9371-aae4575a0fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:51 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Volume cf73d299-830f-4a1e-b4c3-be516a0dc83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c', 'volume_size': 1} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a870cf6-46ec-43cb-8b2b-fbf0d7f5410a,created_at=2026-07-08T01:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1696363232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a870cf6-46ec-43cb-8b2b-fbf0d7f5410a,host='devstack@QuobyteHD#QuobyteHD',id=cf73d299-830f-4a1e-b4c3-be516a0dc83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:51Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a91d5fd-250e-42d2-8098-4b93f1f53a88),volume_type_id=3a91d5fd-250e-42d2-8098-4b93f1f53a88)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Creating volume cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:33:51 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:51 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c 1073741824 Jul 08 03:33:51 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:51 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD" returned: 0 in 0.989s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:51 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD Jul 08 03:33:51 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:51 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.58ca2d12-c754-48d1-a266-2ed678418582" returned: 0 in 0.888s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-58ca2d12-c754-48d1-a266-2ed678418582" released by "_delete_snapshot" :: held 3.527s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" released by "delete_snapshot" :: held 3.584s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:51 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Created reservations ['996d8eae-9f5b-4033-b53d-7f420f3e228e', 'f2aee005-1d76-439d-8d0c-358530583601', '2092d560-7b20-4ce3-bc7d-54b997a28b48', 'b562330f-a826-4f58-b6b4-8dc6d507c099'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Delete snapshot completed successfully. Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ebd8c2bb-9e77-417b-9383-ad9fa5768c87 tempest-SnapshotsActionsTest-1228891826 None] Lock "cinder-58ca2d12-c754-48d1-a266-2ed678418582-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:52 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD" returned: 1 in 0.910s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:52 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c 1073741824" returned: 0 in 1.164s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:52 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c Jul 08 03:33:52 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "cinder-b48637d0-7fed-427d-a6fb-2916942087d1-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-b48637d0-7fed-427d-a6fb-2916942087d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "cinder-quobyte-b48637d0-7fed-427d-a6fb-2916942087d1" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-quobyte-b48637d0-7fed-427d-a6fb-2916942087d1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Deleting offline snapshot b48637d0-7fed-427d-a6fb-2916942087d1 of volume 7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] snapshot_file for this snap is: volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d621cad0-a2e9-4dc2-aea2-377a6bea2eef]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:53 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:53 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:53 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c" returned: 0 in 0.802s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dea593-6f93-4272-90d5-fde39477cf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1f3ee6fb8e45a49f23d77cece2cdd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:33:48Z,use_quota=True,user_id='dae675445367408ca200a0fd352da16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac41924-f423-456e-9b1c-af98cc83f5f3),volume_type_id=9ac41924-f423-456e-9b1c-af98cc83f5f3)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Creating volume 54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:33:53 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39eb8e8c-c2e1-4063-9371-aae4575a0fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:53 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 1073741824 Jul 08 03:33:53 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2c8de5-b8bc-4b6f-a7c4-2f157ee72ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:33:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Volume volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c (cf73d299-830f-4a1e-b4c3-be516a0dc83c): created successfully Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2c8de5-b8bc-4b6f-a7c4-2f157ee72ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (1e08003a-2451-4914-abd8-1e7714e91da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:33:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6e5bc768-be09-470d-b4ca-a7c85b650dbf tempest-GroupSnapshotsTest-720221876 None] Created volume successfully. Jul 08 03:33:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b5fc5554-e0c6-4172-8ab6-a4c366d151ae tempest-GroupSnapshotsTest-720221876 None] Update group completed successfully. Jul 08 03:33:53 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.992s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccda659-3c36-454e-bc04-0e22c97dca63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:33:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4979ce0a-adea-4a6c-9481-5e4127b1c23f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:54 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 Jul 08 03:33:54 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:54 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 1073741824" returned: 0 in 1.091s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:54 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:33:54 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:54 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:54 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:54 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-57aa65dc-a2b4-4e2c-9335-2a9bee2609b0 tempest-GroupSnapshotsTest-720221876 None] Update group completed successfully. Jul 08 03:33:55 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 0 in 0.663s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Attempting download of 478336aa-2286-46d6-8145-13fe79efb2e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/478336aa-2286-46d6-8145-13fe79efb2e6', 'metadata': {}}])) to volume 54dea593-6f93-4272-90d5-fde39477cf50. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[517c7764-f026-4419-9e1d-63ce9fe728eb]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:55 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5 Jul 08 03:33:55 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:55 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:55 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1 Jul 08 03:33:55 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:55 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:56 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5 Jul 08 03:33:56 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-66f777ca-bb33-4911-93d1-568ef08b94a9 tempest-GroupSnapshotsTest-720221876 None] Update group completed successfully. Jul 08 03:33:56 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63.b48637d0-7fed-427d-a6fb-2916942087d1" returned: 0 in 0.698s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-quobyte-b48637d0-7fed-427d-a6fb-2916942087d1" released by "_delete_snapshot" :: held 3.364s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" released by "delete_snapshot" :: held 3.385s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Created reservations ['3d9d182e-2e92-41fc-8d7c-54beed5b75aa', 'b8c63b16-7fe3-45f0-bd27-93f603eed4a9', 'd9c97314-3fb4-4ff6-a4dc-318d6dc77de8', '4ccab7a6-4348-466f-88c2-9732a7509904'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Delete snapshot completed successfully. Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4cf78c34-506a-4285-b909-b8c6c11b035b tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-b48637d0-7fed-427d-a6fb-2916942087d1-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:56 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5" returned: 1 in 0.821s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_478336aa-2286-46d6-8145-13fe79efb2e6_al3bi4o5' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c3656-4def-421c-bab6-d2dbef1d1cf9]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:56 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD Jul 08 03:33:56 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "cinder-7ccda659-3c36-454e-bc04-0e22c97dca63-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-7ccda659-3c36-454e-bc04-0e22c97dca63-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[218865d6-aca6-49f1-b0f9-203d71c0ff05]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-97988519-8349-4517-9d5a-75ee83decfb3 tempest-GroupSnapshotsTest-720221876 None] Update group completed successfully. Jul 08 03:33:57 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 Jul 08 03:33:57 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD" returned: 0 in 1.095s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:57 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:57 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD Jul 08 03:33:57 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:58 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63" returned: 0 in 1.019s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:58 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63 Jul 08 03:33:58 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:58 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:33:58 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] 478336aa-2286-46d6-8145-13fe79efb2e6 was raw, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:33:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:58 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:33:58 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] GroupSnapshot b834e47a-8329-411d-8c64-08fefa4be54a: creating. Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Group snapshot b834e47a-8329-411d-8c64-08fefa4be54a: creating. {{(pid=86294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Creating offline snapshot 74d6e16a-e12e-487b-aaad-9d54b97c22f9 of volume cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f7326f-5321-4711-86c8-a7b892a406c9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:59 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c Jul 08 03:33:59 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:59 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ccda659-3c36-454e-bc04-0e22c97dca63" returned: 0 in 1.012s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:59 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 0 in 0.956s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_478336aa-2286-46d6-8145-13fe79efb2e6_5aw8d8txdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:33:59 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-quobyte-7ccda659-3c36-454e-bc04-0e22c97dca63" released by "delete_volume" :: held 2.146s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:33:59 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 1G Jul 08 03:33:59 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Created reservations ['9338a5e0-b54c-488a-bc31-4bbeb9f173af', '40f860a7-1dda-4c6d-b04d-77a61e1c5db8', '4537598e-11c4-41aa-aa2c-62ef23720259', '0643157c-98dc-4bd3-aeed-4e0353743a5e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:33:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:33:59 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:33:59 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:00 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c" returned: 0 in 1.031s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:00 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 1G Jul 08 03:34:00 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:00 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 1G" returned: 0 in 0.832s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e12559-dca0-4da0-bf04-7ce3a1f64197]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:00 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:34:00 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:00 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.066s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:00 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Deleted volume successfully. Jul 08 03:34:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3eb1d991-798f-42e7-8f6c-d8adc5682f81 tempest-SnapshotsActionsTest-268767209 None] Lock "cinder-7ccda659-3c36-454e-bc04-0e22c97dca63-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:01 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 0 in 1.239s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:01 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 1G" returned: 0 in 1.535s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:01 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 Jul 08 03:34:01 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:01 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:34:01 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:02 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9" returned: 0 in 1.100s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:02 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:02 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 1 in 1.194s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Downloaded image 478336aa-2286-46d6-8145-13fe79efb2e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/478336aa-2286-46d6-8145-13fe79efb2e6', 'metadata': {}}])) to volume 54dea593-6f93-4272-90d5-fde39477cf50 successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Temporary image 478336aa-2286-46d6-8145-13fe79efb2e6 for user dae675445367408ca200a0fd352da16e is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:34:02 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Marking volume 54dea593-6f93-4272-90d5-fde39477cf50 as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Copying metadata from image 478336aa-2286-46d6-8145-13fe79efb2e6 to 54dea593-6f93-4272-90d5-fde39477cf50. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Creating volume glance metadata for volume 54dea593-6f93-4272-90d5-fde39477cf50 backed by image 478336aa-2286-46d6-8145-13fe79efb2e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c1d1d8a29a2e0d23825024ff232ec4b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:34:03 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 Jul 08 03:34:03 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e0d37e-1448-42c7-9ea6-90c5671f01e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dea593-6f93-4272-90d5-fde39477cf50', 'volume_size': 1, 'image_id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/478336aa-2286-46d6-8145-13fe79efb2e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1d1d8a29a2e0d23825024ff232ec4b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dd1f3ee6fb8e45a49f23d77cece2cdd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2eb47425bca41622473064e1a779b300123bb92021405b5a180a8c56b57c2a342314a0beb894759fbf908340951e8549e908053bf11094a3a9a4c945302db06c', 'id': '478336aa-2286-46d6-8145-13fe79efb2e6', 'created_at': datetime.datetime(2026, 7, 8, 1, 33, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 33, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/478336aa-2286-46d6-8145-13fe79efb2e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645b18e9-75c1-4c1d-add7-a7dc61d73ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:03 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Volume volume-54dea593-6f93-4272-90d5-fde39477cf50 (54dea593-6f93-4272-90d5-fde39477cf50): created successfully Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645b18e9-75c1-4c1d-add7-a7dc61d73ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Flow 'volume_create_manager' (f7fd7215-c925-452b-abf3-a7677576ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:03 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-36c31f81-a5fc-4e14-800d-14abecd6c48b tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Created volume successfully. Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Acquiring lock "cinder-54dea593-6f93-4272-90d5-fde39477cf50-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "cinder-54dea593-6f93-4272-90d5-fde39477cf50-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Acquiring lock "cinder-quobyte-54dea593-6f93-4272-90d5-fde39477cf50" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "cinder-quobyte-54dea593-6f93-4272-90d5-fde39477cf50" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9543e40-a119-4e07-8a6a-3c6d668465ba]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:03 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:34:03 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:04 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9" returned: 0 in 1.295s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:04 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info Jul 08 03:34:04 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:04 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 0 in 1.011s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:05 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:34:05 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:05 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info" returned: 0 in 1.020s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:05 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:34:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:05 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info Jul 08 03:34:05 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:06 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 1 in 1.253s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:06 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50 Jul 08 03:34:06 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:06 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.info" returned: 0 in 0.901s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Creating offline snapshot e09de9da-58a6-4f62-beff-2ff0e7633074 of volume ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[93905b5f-b894-4380-adc5-a1ce0e740b85]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:06 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd Jul 08 03:34:06 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:06 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54dea593-6f93-4272-90d5-fde39477cf50" returned: 0 in 0.767s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "cinder-quobyte-54dea593-6f93-4272-90d5-fde39477cf50" released by "delete_volume" :: held 3.134s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:06 devstack cinder-volume[86294]: WARNING cinder.quota [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:06 devstack cinder-volume[86294]: WARNING cinder.quota [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Created reservations ['34fc4655-dee8-4b4a-a7b5-9c34407b9e54', 'a8078ee2-80bc-495a-bbcd-8b6d5c64f925', '2092819d-71d7-4cff-aa91-f78505b89d10', '8902d32b-b775-4d97-83e2-f3789f262ed3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:07 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:07 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:07 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" returned: 0 in 1.213s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:07 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 1G Jul 08 03:34:07 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:08 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.129s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:08 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Deleted volume successfully. Jul 08 03:34:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b02e0deb-dbc7-44f7-870b-1184a33b8f4f tempest-VolumeAndVolumeTypeFromImageTest-1932396196 None] Lock "cinder-54dea593-6f93-4272-90d5-fde39477cf50-delete_volume" released by "delete_volume" :: held 4.581s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:08 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 1G" returned: 0 in 1.335s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:08 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 Jul 08 03:34:08 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:09 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074" returned: 0 in 0.813s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:09 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:34:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:09 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 Jul 08 03:34:09 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:10 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074" returned: 0 in 0.905s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:10 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=123,cinder:INSERT=33,cinder:UPDATE=103,cinder:DELETE=6 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:34:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:10 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info Jul 08 03:34:10 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:11 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info" returned: 0 in 1.045s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:11 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:34:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:11 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info Jul 08 03:34:11 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:12 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.info" returned: 0 in 0.894s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.331s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:12 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=99,cinder:DELETE=5,cinder:UPDATE=107,cinder:INSERT=30 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:34:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0e626772-efd0-4e57-81cd-e8077c6eef97 tempest-GroupSnapshotsTest-720221876 None] group_snapshot b834e47a-8329-411d-8c64-08fefa4be54a: created successfully Jul 08 03:34:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] group_snapshot b834e47a-8329-411d-8c64-08fefa4be54a: deleting Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] group_snapshot b834e47a-8329-411d-8c64-08fefa4be54a: deleting {{(pid=86294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-cf73d299-830f-4a1e-b4c3-be516a0dc83c" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-cf73d299-830f-4a1e-b4c3-be516a0dc83c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-74d6e16a-e12e-487b-aaad-9d54b97c22f9" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-74d6e16a-e12e-487b-aaad-9d54b97c22f9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Deleting offline snapshot 74d6e16a-e12e-487b-aaad-9d54b97c22f9 of volume cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] snapshot_file for this snap is: volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b656fee3-1460-47d4-86c2-3f0a8d5a56da]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (70316527-3411-4400-aa1d-41c64668ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c37f46a-e38b-4bfc-9a95-ddfef02d38b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c37f46a-e38b-4bfc-9a95-ddfef02d38b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134087178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465183e7-b3ae-4616-92e8-3f9ec774e954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:13Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bc3e64-a036-4592-9257-fbbaeaa52250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bc3e64-a036-4592-9257-fbbaeaa52250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c9d0aa-b10c-4909-a65e-f92698f361ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c9d0aa-b10c-4909-a65e-f92698f361ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465183e7-b3ae-4616-92e8-3f9ec774e954', 'volume_name': 'volume-465183e7-b3ae-4616-92e8-3f9ec774e954', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c385cf0-2529-45e3-bef2-90c441346d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:13 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 Jul 08 03:34:13 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c385cf0-2529-45e3-bef2-90c441346d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c92cee-8235-454e-9684-752ceefddb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:13 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume 465183e7-b3ae-4616-92e8-3f9ec774e954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465183e7-b3ae-4616-92e8-3f9ec774e954', 'volume_size': 1} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134087178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465183e7-b3ae-4616-92e8-3f9ec774e954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:13Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating volume 465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:13 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:13 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 1073741824 Jul 08 03:34:13 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:14 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9" returned: 0 in 0.833s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:34:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c645f16e-ab38-4d74-b571-9a0e8e14999c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:14 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c Jul 08 03:34:14 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:14 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 1073741824" returned: 0 in 0.958s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:14 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 Jul 08 03:34:14 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:15 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c" returned: 0 in 0.837s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:15 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 Jul 08 03:34:15 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:15 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c92cee-8235-454e-9684-752ceefddb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465183e7-b3ae-4616-92e8-3f9ec774e954', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadb3579-2855-49c6-8be8-e32bd2c1a061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume volume-465183e7-b3ae-4616-92e8-3f9ec774e954 (465183e7-b3ae-4616-92e8-3f9ec774e954): created successfully Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadb3579-2855-49c6-8be8-e32bd2c1a061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (70316527-3411-4400-aa1d-41c64668ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2a739649-1933-46a0-9e0c-7700550a9119 tempest-CreateVolumesFromSnapshotTest-855227716 None] Created volume successfully. Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating offline snapshot 1c6f55f7-dd46-46cc-9782-32a851f7f507 of volume 465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[61081942-dc1f-4ffc-9345-5542d097ed5c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:15 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 Jul 08 03:34:15 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:16 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9" returned: 0 in 0.801s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:16 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9 Jul 08 03:34:16 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Flow 'volume_create_manager' (11d4c142-309c-4cbe-acb4-4df28a9f0ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2e2fa-8ae4-4662-bc83-cf6b539585c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2e2fa-8ae4-4662-bc83-cf6b539585c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1717028142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f765af051c4aa795a5336d96b344db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:16Z,use_quota=True,user_id='06d89554f1fa418abc4db8c0f009a210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad1ad7d-0394-44d0-972c-a3e2378643d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad1ad7d-0394-44d0-972c-a3e2378643d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff535cc5-f1f2-4fd2-8b4b-b8264b0cbc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff535cc5-f1f2-4fd2-8b4b-b8264b0cbc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3', 'volume_name': 'volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b95f6d-4c27-4205-8922-6688ec2514d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b95f6d-4c27-4205-8922-6688ec2514d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb3ca91-cc58-46f2-aa1f-91d109bef0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Volume c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3', 'volume_size': 1} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:16 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954" returned: 0 in 0.804s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:16 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 1G Jul 08 03:34:16 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:16 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c.74d6e16a-e12e-487b-aaad-9d54b97c22f9" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-74d6e16a-e12e-487b-aaad-9d54b97c22f9" released by "_delete_snapshot" :: held 3.271s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-cf73d299-830f-4a1e-b4c3-be516a0dc83c" released by "delete_snapshot" :: held 3.297s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-e09de9da-58a6-4f62-beff-2ff0e7633074" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-e09de9da-58a6-4f62-beff-2ff0e7633074" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Deleting offline snapshot e09de9da-58a6-4f62-beff-2ff0e7633074 of volume ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] snapshot_file for this snap is: volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b772f92-6a60-4246-95aa-c1ebccef98d7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:16 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 Jul 08 03:34:16 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:17 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 1G" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465183e7-b3ae-4616-92e8-3f9ec774e954 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:17 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465183e7-b3ae-4616-92e8-3f9ec774e954 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 Jul 08 03:34:17 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:17 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074" returned: 0 in 0.766s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:34:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88aac0b-832d-478c-a65b-01e4b50480d1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:17 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd Jul 08 03:34:17 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:18 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465183e7-b3ae-4616-92e8-3f9ec774e954 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:18 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 is being set with open permissions: ugo+rw Jul 08 03:34:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:18 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 Jul 08 03:34:18 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:18 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" returned: 0 in 0.765s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:18 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 Jul 08 03:34:18 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:18 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507" returned: 0 in 0.627s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:18 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info Jul 08 03:34:18 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:19 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074" returned: 0 in 0.728s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:19 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074 Jul 08 03:34:19 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:19 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info" returned: 0 in 0.704s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:19 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info is being set with open permissions: ugo+rw Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:19 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info Jul 08 03:34:19 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:19 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd.e09de9da-58a6-4f62-beff-2ff0e7633074" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-e09de9da-58a6-4f62-beff-2ff0e7633074" released by "_delete_snapshot" :: held 2.994s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" released by "delete_snapshot" :: held 3.017s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:19 devstack cinder-volume[86294]: WARNING cinder.quota [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-692205483 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-692205483, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:19 devstack cinder-volume[86294]: WARNING cinder.quota [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-692205483 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-692205483, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Created reservations ['715a5692-16a0-4ab9-bd05-74ac629997dc', 'b3e62f24-854d-4c56-917e-304dffa5f961', '5a50ade7-8ccd-4cb6-a104-4f4d05578ef8', 'febdf8e9-7e82-469e-bf82-bbfd4a0b82a8'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] Created reservations ['e451fadb-10a8-40ca-b50f-ebc9478d2c0a', '20cc73dc-1db9-4943-bfaa-3fdd2c990f15', '5be92775-6103-4452-91e9-cb452697c29e', '9339b871-c198-4f77-a258-dcbdfda3a6c3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7ecc56af-e681-4feb-ba7e-d09aed696a3b tempest-GroupSnapshotsTest-720221876 None] group_snapshot b834e47a-8329-411d-8c64-08fefa4be54a: deleted successfully Jul 08 03:34:20 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.info" returned: 0 in 0.707s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.440s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.050s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1717028142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f765af051c4aa795a5336d96b344db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:16Z,use_quota=True,user_id='06d89554f1fa418abc4db8c0f009a210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Creating volume c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:20 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:20 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 1073741824 Jul 08 03:34:20 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-01d69fe9-487b-42e2-8bd2-3cd5c5a5f666 tempest-CreateVolumesFromSnapshotTest-855227716 None] Create snapshot completed successfully Jul 08 03:34:21 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 1073741824" returned: 0 in 0.882s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:21 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 Jul 08 03:34:21 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49186db-247b-4ac0-9b71-9dec3c42dbf1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (246fb551-2012-4897-8321-7b9b0265ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3319719-8f49-4d3e-a6de-6beb9a9bcb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3319719-8f49-4d3e-a6de-6beb9a9bcb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1945034065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012d1dd8-5a0c-4902-a61d-978f28fe5770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:22Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfa2cb6-a694-4c45-896e-9c90e00f6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfa2cb6-a694-4c45-896e-9c90e00f6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc4a1ed-e5e4-4142-996e-c5535969a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc4a1ed-e5e4-4142-996e-c5535969a91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012d1dd8-5a0c-4902-a61d-978f28fe5770', 'volume_name': 'volume-012d1dd8-5a0c-4902-a61d-978f28fe5770', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a374c3-f94c-46fc-9f89-10fbe2f67fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a374c3-f94c-46fc-9f89-10fbe2f67fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b7b748-ad5e-4e50-b0e5-511be74e230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:21 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume 012d1dd8-5a0c-4902-a61d-978f28fe5770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012d1dd8-5a0c-4902-a61d-978f28fe5770', 'volume_size': 1} Jul 08 03:34:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:21 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd Jul 08 03:34:21 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:22 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" returned: 0 in 0.939s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1945034065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012d1dd8-5a0c-4902-a61d-978f28fe5770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:22Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating volume 012d1dd8-5a0c-4902-a61d-978f28fe5770 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:22 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:22 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 1073741824 Jul 08 03:34:22 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb3ca91-cc58-46f2-aa1f-91d109bef0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b8ecf2-8dcd-4869-ae1a-30abc2556935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Volume volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 (c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3): created successfully Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b8ecf2-8dcd-4869-ae1a-30abc2556935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Flow 'volume_create_manager' (11d4c142-309c-4cbe-acb4-4df28a9f0ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9a608eca-cc91-4f8c-b7b7-df1846fcb7b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Created volume successfully. Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (6fcfa323-bed1-4844-85a6-e0e75fe60644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f96962-e5ef-459f-ba08-f03f79db7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f96962-e5ef-459f-ba08-f03f79db7f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004829662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7734a3-7061-4132-a378-b4ef2c8c42d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:22Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672664e6-fc27-4d5c-ba88-1885aadc8e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672664e6-fc27-4d5c-ba88-1885aadc8e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f03328-656d-4e52-973d-cb48cc4fae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f03328-656d-4e52-973d-cb48cc4fae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7734a3-7061-4132-a378-b4ef2c8c42d6', 'volume_name': 'volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87a7143-ab19-498c-a37a-b6c4f6894bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87a7143-ab19-498c-a37a-b6c4f6894bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a5245b-e64b-4b3d-9d4f-2a2727f8eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume 7a7734a3-7061-4132-a378-b4ef2c8c42d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6', 'volume_size': 1} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:22 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" returned: 0 in 1.243s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:23 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd Jul 08 03:34:23 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (447e6433-df11-4043-9bf7-1880175b2f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5a91d8-f0f4-46b1-899b-ecd3dd7052ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5a91d8-f0f4-46b1-899b-ecd3dd7052ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386909477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2573bb-72d7-417d-a559-a6cc46669690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:23Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2d2d80-45ba-439e-a591-5da793b442b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2d2d80-45ba-439e-a591-5da793b442b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aef1d7-c8b6-46e6-b2e0-de605a16edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5aef1d7-c8b6-46e6-b2e0-de605a16edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2573bb-72d7-417d-a559-a6cc46669690', 'volume_name': 'volume-7f2573bb-72d7-417d-a559-a6cc46669690', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2504055d-0037-4d03-b4c3-ce444f22f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2504055d-0037-4d03-b4c3-ce444f22f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b08400-3343-4d38-b029-2856515215eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume 7f2573bb-72d7-417d-a559-a6cc46669690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2573bb-72d7-417d-a559-a6cc46669690', 'volume_size': 1} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:23 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 1073741824" returned: 0 in 1.207s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:23 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 Jul 08 03:34:23 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (e40aea69-bc88-4e09-aa24-184d6ba1b128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bc93cd-546b-485f-90e3-3f4a42e8105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bc93cd-546b-485f-90e3-3f4a42e8105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-60871127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759f3f31-e042-4c4f-be59-b16ff2991112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:23Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3213ee-8be2-4256-aa13-8020ed04bf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3213ee-8be2-4256-aa13-8020ed04bf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ca0341-4c52-4bc2-a0f3-06b4a251bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ca0341-4c52-4bc2-a0f3-06b4a251bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759f3f31-e042-4c4f-be59-b16ff2991112', 'volume_name': 'volume-759f3f31-e042-4c4f-be59-b16ff2991112', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664f5fdf-cbb1-4277-be2b-424e91299eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664f5fdf-cbb1-4277-be2b-424e91299eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59302e15-8523-43e4-aa0d-87e5dc80b190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume 759f3f31-e042-4c4f-be59-b16ff2991112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759f3f31-e042-4c4f-be59-b16ff2991112', 'volume_size': 1} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:23 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-ab451d18-b9fa-43b5-8f1e-efd6662a03fd" released by "delete_volume" :: held 2.114s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-cf73d299-830f-4a1e-b4c3-be516a0dc83c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (ee4c379d-9a92-4479-a55e-6049bdb210db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d766e067-e606-448f-9575-ecfe17184f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-cf73d299-830f-4a1e-b4c3-be516a0dc83c" acquired by "delete_volume" :: waited 0.051s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d766e067-e606-448f-9575-ecfe17184f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155479718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6444973-34bd-4030-a139-7c58546c94a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:24Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101e978c-77d3-4cd8-946d-919481e585e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101e978c-77d3-4cd8-946d-919481e585e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e2f954-c9b2-491f-bd9c-4390f2ad5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e2f954-c9b2-491f-bd9c-4390f2ad5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6444973-34bd-4030-a139-7c58546c94a4', 'volume_name': 'volume-f6444973-34bd-4030-a139-7c58546c94a4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affc3e43-d78d-4201-bf4a-830b31bc9dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affc3e43-d78d-4201-bf4a-830b31bc9dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ad378f-a9c0-4aac-8b20-856df9b2622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:23 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume f6444973-34bd-4030-a139-7c58546c94a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6444973-34bd-4030-a139-7c58546c94a4', 'volume_size': 1} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe9bd9-a4cd-4137-8a2d-c509b94aae49]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:24 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c Jul 08 03:34:24 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:24 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004829662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7734a3-7061-4132-a378-b4ef2c8c42d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:22Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating volume 7a7734a3-7061-4132-a378-b4ef2c8c42d6 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:24 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:24 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 1073741824 Jul 08 03:34:24 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b7b748-ad5e-4e50-b0e5-511be74e230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012d1dd8-5a0c-4902-a61d-978f28fe5770', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593ff4d2-791f-45a1-be60-4ae019c6edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:24 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 (012d1dd8-5a0c-4902-a61d-978f28fe5770): created successfully Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593ff4d2-791f-45a1-be60-4ae019c6edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (246fb551-2012-4897-8321-7b9b0265ab59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4e81eb38-d656-44e6-afe0-bd1c7a187694 tempest-CreateVolumesFromSnapshotTest-855227716 None] Created volume successfully. Jul 08 03:34:24 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c" returned: 0 in 0.834s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:24 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c Jul 08 03:34:24 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Flow 'volume_create_manager' (533f4253-3fb8-4529-ae37-af9bbdb2ff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4cded9-f378-4b7e-b3d3-5149f3c9195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4cded9-f378-4b7e-b3d3-5149f3c9195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1266222999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0102da55-df93-495f-b07b-5c13665ddbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc67961694f0459aa724e2df0053e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:25Z,use_quota=True,user_id='4d903f02cb304be68b24218c9337293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632cfad7-9be1-4bc5-9ec3-49f1dd1590e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632cfad7-9be1-4bc5-9ec3-49f1dd1590e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c66c4b-3320-420a-a3da-58f8471671a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c66c4b-3320-420a-a3da-58f8471671a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0102da55-df93-495f-b07b-5c13665ddbdd', 'volume_name': 'volume-0102da55-df93-495f-b07b-5c13665ddbdd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8353b5fd-3f55-4013-879c-4cb29e42d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8353b5fd-3f55-4013-879c-4cb29e42d02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f6d1d5-d9f6-4ce7-98d4-aef3b27dbeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:24 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Volume 0102da55-df93-495f-b07b-5c13665ddbdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0102da55-df93-495f-b07b-5c13665ddbdd', 'volume_size': 1} Jul 08 03:34:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:25 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 1073741824" returned: 0 in 0.985s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:25 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 Jul 08 03:34:25 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:25 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cf73d299-830f-4a1e-b4c3-be516a0dc83c" returned: 0 in 0.713s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-cf73d299-830f-4a1e-b4c3-be516a0dc83c" released by "delete_volume" :: held 1.655s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Created reservations ['57c53863-8fe3-4c6f-bd77-ecf66822e429'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:25 devstack cinder-volume[86294]: WARNING cinder.quota [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-692205483 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-692205483, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Created reservations ['692c2228-771f-4fa7-9be4-c236f3c37dc0', 'c6e90f63-946f-475b-b248-1cb4a65acdb7', 'b82a5a55-96c4-4444-bc83-4bc92421aff0', '32fbfbb8-1d9c-464d-aba1-9402031f9da2'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Created reservations ['bb7d5235-bf54-447e-8fc9-9dd7bc193565', 'd3410243-e9cb-483c-860c-c548ba4c2d08', 'f2a1f2bc-8ce0-426c-a8ac-a103dca79c1f', '01c005a5-aff7-4b76-8904-6a1eb617d612'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:25 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.652s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a5245b-e64b-4b3d-9d4f-2a2727f8eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:25 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:25 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c67fc1e-2066-401b-a9c7-ebf27d3e8389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Creating offline snapshot 0d3e4bc5-de03-4470-82e5-60a132c8e615 of volume c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:34:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 (7a7734a3-7061-4132-a378-b4ef2c8c42d6): created successfully Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c67fc1e-2066-401b-a9c7-ebf27d3e8389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (6fcfa323-bed1-4844-85a6-e0e75fe60644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9fa0fc-c6f6-430e-9cfe-eda79ff3086d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5db152e6-72fa-4149-827a-eb13bea6990b tempest-CreateVolumesFromSnapshotTest-855227716 None] Created volume successfully. Jul 08 03:34:25 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 Jul 08 03:34:25 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:26 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:26 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b9d3193f-b4c3-4ed0-9688-9411907b777f tempest-GroupSnapshotsTest-720221876 None] Delete group completed successfully. Jul 08 03:34:26 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:26 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 1G Jul 08 03:34:26 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5d3ed4cb-1b65-4960-9450-31beeb11437c tempest-GroupSnapshotsTest-720221876 None] Group tempest-GroupSnapshotsTest-Group-661792966: creating Jul 08 03:34:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5d3ed4cb-1b65-4960-9450-31beeb11437c tempest-GroupSnapshotsTest-720221876 None] Group tempest-GroupSnapshotsTest-Group-661792966: created successfully Jul 08 03:34:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5d3ed4cb-1b65-4960-9450-31beeb11437c tempest-GroupSnapshotsTest-720221876 None] Create group completed successfully. Jul 08 03:34:27 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 1G" returned: 0 in 0.830s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:27 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 Jul 08 03:34:27 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:28 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615" returned: 0 in 0.716s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:28 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 is being set with open permissions: ugo+rw Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:28 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 Jul 08 03:34:28 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (d9988a7a-45ca-40bf-9308-817e2735eaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa077312-922f-4ed8-9968-0b41d836c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa077312-922f-4ed8-9968-0b41d836c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039568946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10363442-3d8e-4e16-9dca-f824a0e30ac3,host='devstack@QuobyteHD#QuobyteHD',id=dbf24989-aa1b-438b-88fc-7bee3c8b7666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:28Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bbaa3c-6df5-4a3e-a66c-089e23581740),volume_type_id=10bbaa3c-6df5-4a3e-a66c-089e23581740)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8f6b30-302d-4235-8e9e-ebc35214dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8f6b30-302d-4235-8e9e-ebc35214dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45643a4d-8646-4d0f-9a8e-ac631be92b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45643a4d-8646-4d0f-9a8e-ac631be92b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf24989-aa1b-438b-88fc-7bee3c8b7666', 'volume_name': 'volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f91efb-af43-4f49-9d04-953b31d9df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f91efb-af43-4f49-9d04-953b31d9df1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09406bb5-b6ba-42fc-a524-7ab117b7dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:28 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Volume dbf24989-aa1b-438b-88fc-7bee3c8b7666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666', 'volume_size': 1} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:28 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615" returned: 0 in 0.650s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:28 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info Jul 08 03:34:28 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:29 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:29 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info is being set with open permissions: ugo+rw Jul 08 03:34:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:29 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info Jul 08 03:34:29 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:30 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.info" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.402s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.955s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386909477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2573bb-72d7-417d-a559-a6cc46669690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:23Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating volume 7f2573bb-72d7-417d-a559-a6cc46669690 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:30 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:30 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 1073741824 Jul 08 03:34:30 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8d2006ac-61ce-4b3f-b71d-c1997f1cf12d tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Create snapshot completed successfully Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "cinder-0d3e4bc5-de03-4470-82e5-60a132c8e615-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-0d3e4bc5-de03-4470-82e5-60a132c8e615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "cinder-quobyte-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-quobyte-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "cinder-quobyte-0d3e4bc5-de03-4470-82e5-60a132c8e615" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-quobyte-0d3e4bc5-de03-4470-82e5-60a132c8e615" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Deleting offline snapshot 0d3e4bc5-de03-4470-82e5-60a132c8e615 of volume c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] snapshot_file for this snap is: volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b7718-0199-4903-a93d-cbf9ec8a66e5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:31 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 Jul 08 03:34:31 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:31 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 1073741824" returned: 0 in 0.863s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:31 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 Jul 08 03:34:31 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:31 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615" returned: 0 in 0.766s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf90189e-d9d2-479b-b7c7-4aa54604a870]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:31 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690" returned: 0 in 0.669s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:31 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 Jul 08 03:34:31 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.257s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-60871127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759f3f31-e042-4c4f-be59-b16ff2991112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:23Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating volume 759f3f31-e042-4c4f-be59-b16ff2991112 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:31 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:31 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 1073741824 Jul 08 03:34:31 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b08400-3343-4d38-b029-2856515215eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2573bb-72d7-417d-a559-a6cc46669690', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50797159-909a-40aa-89b6-e3514a630456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:31 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume volume-7f2573bb-72d7-417d-a559-a6cc46669690 (7f2573bb-72d7-417d-a559-a6cc46669690): created successfully Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50797159-909a-40aa-89b6-e3514a630456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (447e6433-df11-4043-9bf7-1880175b2f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-aaf8743a-3b69-4c54-bc6b-9b1ac7ff32cc tempest-CreateVolumesFromSnapshotTest-855227716 None] Created volume successfully. Jul 08 03:34:32 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" returned: 0 in 0.851s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:32 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 Jul 08 03:34:32 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:32 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 1073741824" returned: 0 in 0.867s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:32 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 Jul 08 03:34:32 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:33 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:33 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615 Jul 08 03:34:33 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:33 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112" returned: 0 in 0.661s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.446s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155479718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6444973-34bd-4030-a139-7c58546c94a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859133a393784f4597985225df9631e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:24Z,use_quota=True,user_id='1cb8890f3ea6491e92dd8219ba489cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Creating volume f6444973-34bd-4030-a139-7c58546c94a4 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:33 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59302e15-8523-43e4-aa0d-87e5dc80b190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759f3f31-e042-4c4f-be59-b16ff2991112', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:33 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 1073741824 Jul 08 03:34:33 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a5b42f-4c5c-4927-840f-41f0ef44f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:33 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume volume-759f3f31-e042-4c4f-be59-b16ff2991112 (759f3f31-e042-4c4f-be59-b16ff2991112): created successfully Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a5b42f-4c5c-4927-840f-41f0ef44f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (e40aea69-bc88-4e09-aa24-184d6ba1b128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-500a077d-aad4-4437-829d-fee684a7d728 tempest-CreateVolumesFromSnapshotTest-855227716 None] Created volume successfully. Jul 08 03:34:33 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3.0d3e4bc5-de03-4470-82e5-60a132c8e615" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-quobyte-0d3e4bc5-de03-4470-82e5-60a132c8e615" released by "_delete_snapshot" :: held 3.131s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-quobyte-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" released by "delete_snapshot" :: held 3.154s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Created reservations ['b65bc299-1d09-4887-93f0-70d910af3294', '61bbd8c5-d0c2-4300-94d5-81b5b5af33fb', '7d7a6360-a9f3-4486-90f9-02538161393c', '4dfc8e3d-2e87-43dc-a8e0-3302040227e9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Delete snapshot completed successfully. Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e49e54ca-d3a4-40cf-82c8-cc03a53f85dc tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-0d3e4bc5-de03-4470-82e5-60a132c8e615-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:34 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 1073741824" returned: 0 in 0.862s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:34 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 Jul 08 03:34:34 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:34 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4" returned: 0 in 0.659s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.036s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1266222999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0102da55-df93-495f-b07b-5c13665ddbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc67961694f0459aa724e2df0053e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:25Z,use_quota=True,user_id='4d903f02cb304be68b24218c9337293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Creating volume 0102da55-df93-495f-b07b-5c13665ddbdd {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:34 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ad378f-a9c0-4aac-8b20-856df9b2622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6444973-34bd-4030-a139-7c58546c94a4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:35 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd 1073741824 Jul 08 03:34:35 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85460fdb-0eb5-4611-bcee-3f628b57812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:35 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Volume volume-f6444973-34bd-4030-a139-7c58546c94a4 (f6444973-34bd-4030-a139-7c58546c94a4): created successfully Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85460fdb-0eb5-4611-bcee-3f628b57812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Flow 'volume_create_manager' (ee4c379d-9a92-4479-a55e-6049bdb210db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c6a92fad-105b-45e2-aba7-41dfe73901df tempest-CreateVolumesFromSnapshotTest-855227716 None] Created volume successfully. Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "cinder-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "cinder-quobyte-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-quobyte-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5423d4-c992-47d3-b68e-c0e3543cc2ee]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:35 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 Jul 08 03:34:35 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-f6444973-34bd-4030-a139-7c58546c94a4-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-f6444973-34bd-4030-a139-7c58546c94a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-f6444973-34bd-4030-a139-7c58546c94a4" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-f6444973-34bd-4030-a139-7c58546c94a4" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd76872-a3f7-44f6-a2e1-c09a05a9ad64]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:35 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd 1073741824" returned: 0 in 0.943s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:35 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 Jul 08 03:34:35 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:35 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd Jul 08 03:34:35 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:36 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" returned: 0 in 0.854s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:36 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3 Jul 08 03:34:36 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:36 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4" returned: 0 in 0.835s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:36 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd" returned: 0 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.141s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=10363442-3d8e-4e16-9dca-f824a0e30ac3,created_at=2026-07-08T01:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039568946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10363442-3d8e-4e16-9dca-f824a0e30ac3,host='devstack@QuobyteHD#QuobyteHD',id=dbf24989-aa1b-438b-88fc-7bee3c8b7666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f1e67470e24f2eb891e467ca1b8e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:34:28Z,use_quota=True,user_id='5c1fba435db94f7f9684965bd788757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bbaa3c-6df5-4a3e-a66c-089e23581740),volume_type_id=10bbaa3c-6df5-4a3e-a66c-089e23581740)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Creating volume dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:36 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4 Jul 08 03:34:36 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:34:36 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:36 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 1073741824 Jul 08 03:34:36 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:36 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f6d1d5-d9f6-4ce7-98d4-aef3b27dbeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0102da55-df93-495f-b07b-5c13665ddbdd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415b88e8-876b-4e9c-8054-d8e9208a4bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" returned: 0 in 0.687s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-quobyte-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3" released by "delete_volume" :: held 1.600s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Volume volume-0102da55-df93-495f-b07b-5c13665ddbdd (0102da55-df93-495f-b07b-5c13665ddbdd): created successfully Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415b88e8-876b-4e9c-8054-d8e9208a4bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Flow 'volume_create_manager' (533f4253-3fb8-4529-ae37-af9bbdb2ff98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:36 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f6e65450-1b85-4ecf-b53f-d55278bb65ae tempest-AttachVolumeNegativeTest-974566903 None] Created volume successfully. Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Created reservations ['ff5715ca-8cdc-4e58-8e75-9f1e0fbbb8bf', 'f8016539-c493-449d-a953-b629a314195e', 'a9095513-8660-4949-9900-0cb55fa5809a', 'a7e508a5-a581-48b2-b8d3-8b43887af7b6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:36 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:36 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:37 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6444973-34bd-4030-a139-7c58546c94a4" returned: 0 in 0.744s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-f6444973-34bd-4030-a139-7c58546c94a4" released by "delete_volume" :: held 1.630s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['6aa38716-a407-491d-b62c-56d50bab1d60', '80bc16fb-bc05-448f-ba77-9944186b33af', '96b8c16e-d83a-4977-8816-2bf60d3dd921', 'ea9bc0bb-41fd-4f17-9e9a-03534a5de951'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:37 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 1073741824" returned: 0 in 0.960s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:37 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:37 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:37 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:37 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 Jul 08 03:34:37 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Deleted volume successfully. Jul 08 03:34:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-208e7e32-33fc-451c-948c-c65ca2eafbb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-324855683 None] Lock "cinder-c0d2f8ec-e00b-4a18-add0-0456ddbdc8a3-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-759f3f31-e042-4c4f-be59-b16ff2991112-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-759f3f31-e042-4c4f-be59-b16ff2991112-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-759f3f31-e042-4c4f-be59-b16ff2991112" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-759f3f31-e042-4c4f-be59-b16ff2991112" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e602712-e346-4ff8-a6a0-ce0b8a414610]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:38 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 Jul 08 03:34:38 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:38 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666" returned: 0 in 0.849s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:38 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.943s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleted volume successfully. Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09406bb5-b6ba-42fc-a524-7ab117b7dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c448dae5-c59f-4b97-ba39-e2df37353577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:34:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Volume volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 (dbf24989-aa1b-438b-88fc-7bee3c8b7666): created successfully Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c448dae5-c59f-4b97-ba39-e2df37353577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Flow 'volume_create_manager' (d9988a7a-45ca-40bf-9308-817e2735eaf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:34:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-bda3859d-43d2-43e6-b50d-861cc6c2b9ea tempest-GroupSnapshotsTest-720221876 None] Created volume successfully. Jul 08 03:34:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f01891c-efac-40f2-907b-626ae578bd2a tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-f6444973-34bd-4030-a139-7c58546c94a4-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:39 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112" returned: 0 in 0.910s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:39 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112 Jul 08 03:34:39 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] GroupSnapshot 029809f7-4e8c-4475-a3ab-ddbce767f5a9: creating. Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Group snapshot 029809f7-4e8c-4475-a3ab-ddbce767f5a9: creating. {{(pid=86294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Creating offline snapshot 1f6eae6c-06b5-41cd-8e98-bb76df8009d3 of volume dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbfc6d6-ba09-4c26-86e2-ba0046c9fe6c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:39 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 Jul 08 03:34:39 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:39 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-759f3f31-e042-4c4f-be59-b16ff2991112" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-759f3f31-e042-4c4f-be59-b16ff2991112" released by "delete_volume" :: held 1.753s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:39 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['6af7fc59-8a0d-47f4-8125-7593dc58ecb6', '2d6d7449-596c-45ab-ac33-50cdcab0cc85', '8cc1eabf-4007-4f16-974e-16600886bf32', 'e4b38d41-5b3a-4630-8567-c7b89e345d2c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:40 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:40 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:40 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666" returned: 0 in 0.867s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:40 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 1G Jul 08 03:34:40 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-7f2573bb-72d7-417d-a559-a6cc46669690-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-7f2573bb-72d7-417d-a559-a6cc46669690-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-7f2573bb-72d7-417d-a559-a6cc46669690" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-7f2573bb-72d7-417d-a559-a6cc46669690" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf5083-5dc9-42e0-ba11-a1564c5211cc]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:40 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 Jul 08 03:34:40 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:41 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.916s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:41 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleted volume successfully. Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6678ae34-fc57-44ce-a386-e5c374674b8b tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-759f3f31-e042-4c4f-be59-b16ff2991112-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:41 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 1G" returned: 0 in 1.113s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:41 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 Jul 08 03:34:41 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:41 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690" returned: 0 in 0.960s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:41 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690 Jul 08 03:34:41 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:42 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3" returned: 0 in 0.773s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:42 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:42 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 Jul 08 03:34:42 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:42 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7f2573bb-72d7-417d-a559-a6cc46669690" returned: 0 in 0.750s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-7f2573bb-72d7-417d-a559-a6cc46669690" released by "delete_volume" :: held 1.781s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['c3c9851f-895d-4bc7-9603-cb8d207113e3', 'b148bfc1-c63d-4753-8833-8fc06f6bd90e', 'a6ab9d60-8b64-4606-a4c6-2a98506456f4', '940142f3-e478-4c4e-98bd-6faed62f6b46'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:42 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:42 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-7a7734a3-7061-4132-a378-b4ef2c8c42d6-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-7a7734a3-7061-4132-a378-b4ef2c8c42d6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-7a7734a3-7061-4132-a378-b4ef2c8c42d6" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-7a7734a3-7061-4132-a378-b4ef2c8c42d6" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1267c3-afe2-437b-8ec2-f4b6370e67ac]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:42 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:43 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info Jul 08 03:34:43 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:43 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 Jul 08 03:34:43 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:43 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.804s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleted volume successfully. Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-69899a01-9427-4fd1-b6c1-8ea780da7c53 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-7f2573bb-72d7-417d-a559-a6cc46669690-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:43 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:43 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:43 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6" returned: 0 in 0.886s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:43 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info Jul 08 03:34:43 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:43 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6 Jul 08 03:34:43 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:44 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:44 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.info" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.168s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.075s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7a7734a3-7061-4132-a378-b4ef2c8c42d6" returned: 0 in 0.723s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e999a2-95ea-4dc3-be58-a7fa64747352]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-7a7734a3-7061-4132-a378-b4ef2c8c42d6" released by "delete_volume" :: held 1.674s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['41f40b0d-5085-479a-a8f0-70a865d54540', '471dcc0c-7a54-44f0-a420-e3dfd88fae3a', '904101b7-b352-4115-b061-c4b330d6a97d', '04263f68-878d-4b05-b6fc-9e72e8174b8c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:44 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd Jul 08 03:34:44 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f520ca8d-96db-4f57-957a-3421735d77c6 tempest-GroupSnapshotsTest-720221876 None] group_snapshot 029809f7-4e8c-4475-a3ab-ddbce767f5a9: created successfully Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:44 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:44 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] group_snapshot 029809f7-4e8c-4475-a3ab-ddbce767f5a9: deleting Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] group_snapshot 029809f7-4e8c-4475-a3ab-ddbce767f5a9: deleting {{(pid=86294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-dbf24989-aa1b-438b-88fc-7bee3c8b7666" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-dbf24989-aa1b-438b-88fc-7bee3c8b7666" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-1f6eae6c-06b5-41cd-8e98-bb76df8009d3" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-1f6eae6c-06b5-41cd-8e98-bb76df8009d3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Deleting offline snapshot 1f6eae6c-06b5-41cd-8e98-bb76df8009d3 of volume dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] snapshot_file for this snap is: volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a10a7d-52d1-4d21-9569-1673f04c24cf]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-012d1dd8-5a0c-4902-a61d-978f28fe5770-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-012d1dd8-5a0c-4902-a61d-978f28fe5770-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-012d1dd8-5a0c-4902-a61d-978f28fe5770" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:45 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 Jul 08 03:34:45 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-012d1dd8-5a0c-4902-a61d-978f28fe5770" acquired by "delete_volume" :: waited 0.039s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e012ff81-cf96-46c9-ad45-bbb824dd4850]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:45 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 Jul 08 03:34:45 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:45 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd" returned: 0 in 1.073s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.094s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-0102da55-df93-495f-b07b-5c13665ddbdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc5c3a34-e9a8-44c1-83d4-a59726e004ad', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:34:45 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.976s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleted volume successfully. Jul 08 03:34:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-0aa0020c-ecd2-4ba5-a8c5-ef748b83c8ec req-58804207-c907-4ccd-85bb-32be9d96d0cd tempest-AttachVolumeNegativeTest-974566903 None] attachment_update completed successfully. Jul 08 03:34:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-35735a93-9dfc-4404-bbaa-d941822f300c tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-7a7734a3-7061-4132-a378-b4ef2c8c42d6-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:46 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3" returned: 0 in 1.101s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c98a7-2388-4973-aedc-374dfb8c6a3a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:46 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 Jul 08 03:34:46 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:46 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770" returned: 0 in 1.040s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:46 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770 Jul 08 03:34:46 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:47 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:47 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:47 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666" returned: 0 in 1.003s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:47 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 Jul 08 03:34:47 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:47 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-012d1dd8-5a0c-4902-a61d-978f28fe5770" returned: 0 in 0.954s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-012d1dd8-5a0c-4902-a61d-978f28fe5770" released by "delete_volume" :: held 2.077s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['4918cd5d-a8e2-423a-8d88-0fee510a0b91', '964b9a6f-b55a-4f81-8792-734eb708012e', '07d1a8c4-99d3-4a1b-ad85-e7ba9d8ef3a7', 'bf2b5c3c-ebe1-4d3c-82fd-803bbe20d2bb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:47 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:47 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:48 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.083s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:34:48 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3" returned: 0 in 1.103s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:48 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3 Jul 08 03:34:48 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:48 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.818s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleted volume successfully. Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7608ba23-d818-4d8b-b387-121c41cf3fed tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-012d1dd8-5a0c-4902-a61d-978f28fe5770-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-1c6f55f7-dd46-46cc-9782-32a851f7f507-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-1c6f55f7-dd46-46cc-9782-32a851f7f507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-465183e7-b3ae-4616-92e8-3f9ec774e954" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-465183e7-b3ae-4616-92e8-3f9ec774e954" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-1c6f55f7-dd46-46cc-9782-32a851f7f507" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-1c6f55f7-dd46-46cc-9782-32a851f7f507" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleting offline snapshot 1c6f55f7-dd46-46cc-9782-32a851f7f507 of volume 465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] snapshot_file for this snap is: volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c16e37-0aa4-4956-b2a5-6be1df8a6f48]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:48 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 Jul 08 03:34:48 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:49 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666.1f6eae6c-06b5-41cd-8e98-bb76df8009d3" returned: 0 in 0.870s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-1f6eae6c-06b5-41cd-8e98-bb76df8009d3" released by "_delete_snapshot" :: held 4.247s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-dbf24989-aa1b-438b-88fc-7bee3c8b7666" released by "delete_snapshot" :: held 4.288s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:49 devstack cinder-volume[86294]: WARNING cinder.quota [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-396880122 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-396880122, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:49 devstack cinder-volume[86294]: WARNING cinder.quota [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-396880122 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-396880122, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] Created reservations ['21de750e-e697-4f74-b10c-c816eca7e539', 'e7d06d09-e3bc-4319-a8c1-7e4bcf4a1de0', '51203bcb-4179-405a-80a0-8e3909203056', '907a23b3-ba3f-456c-b2fa-667e6136d029'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-965336ca-1817-4867-b9dd-ff8290e352e9 tempest-GroupSnapshotsTest-720221876 None] group_snapshot 029809f7-4e8c-4475-a3ab-ddbce767f5a9: deleted successfully Jul 08 03:34:49 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507" returned: 0 in 1.064s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-465183e7-b3ae-4616-92e8-3f9ec774e954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc3566-f24b-44d8-a142-99dce6e59464]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:50 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 Jul 08 03:34:50 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:50 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954" returned: 0 in 0.897s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:50 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 Jul 08 03:34:50 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "cinder-quobyte-dbf24989-aa1b-438b-88fc-7bee3c8b7666" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-dbf24989-aa1b-438b-88fc-7bee3c8b7666" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[078913b3-9293-4c59-a0e3-7832e41fec22]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:51 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 Jul 08 03:34:51 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:51 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507" returned: 0 in 0.937s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:51 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507 Jul 08 03:34:51 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:52 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666" returned: 0 in 1.100s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-191ab822-550a-458a-b781-da98952f05bf req-c7a16c7a-9e45-4772-9a42-23a1b8429d16 tempest-AttachVolumeNegativeTest-974566903 None] Terminate volume connection completed successfully. Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-191ab822-550a-458a-b781-da98952f05bf req-c7a16c7a-9e45-4772-9a42-23a1b8429d16 tempest-AttachVolumeNegativeTest-974566903 None] Deleting attachment bc5c3a34-e9a8-44c1-83d4-a59726e004ad. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:34:52 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666 Jul 08 03:34:52 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:52 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954.1c6f55f7-dd46-46cc-9782-32a851f7f507" returned: 0 in 0.894s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-1c6f55f7-dd46-46cc-9782-32a851f7f507" released by "_delete_snapshot" :: held 3.950s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-465183e7-b3ae-4616-92e8-3f9ec774e954" released by "delete_snapshot" :: held 3.977s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['64c88ff7-c8bd-4f70-900e-c0e9934c3be3', '244c55e8-c092-4d37-b29d-0371115154a9', '520ecf16-b5cc-4397-a068-9bc91d2f8aba', 'e1d7f7b0-c3b1-467a-8fba-1195c5c282a8'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Delete snapshot completed successfully. Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae61447c-8ff6-4665-a275-0def424c8bc9 tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-1c6f55f7-dd46-46cc-9782-32a851f7f507-delete_snapshot" released by "delete_snapshot" :: held 4.145s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:52 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-dbf24989-aa1b-438b-88fc-7bee3c8b7666" returned: 0 in 0.802s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Lock "cinder-quobyte-dbf24989-aa1b-438b-88fc-7bee3c8b7666" released by "delete_volume" :: held 1.996s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Created reservations ['43d7bfc7-8880-4387-86de-6ef1bb239b8b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:52 devstack cinder-volume[86294]: WARNING cinder.quota [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-396880122 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-396880122, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Created reservations ['e02c2426-4ae0-4c6e-87df-8b3a911e460c', '4a2d7d5d-ad5c-42b1-8a08-7a2e704e34d5', '9ebf6cb6-f0c6-43c5-b719-8740f934c043', 'e5a0a50c-3376-4454-844e-35840495e310'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-465183e7-b3ae-4616-92e8-3f9ec774e954-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-465183e7-b3ae-4616-92e8-3f9ec774e954-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "cinder-quobyte-465183e7-b3ae-4616-92e8-3f9ec774e954" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-465183e7-b3ae-4616-92e8-3f9ec774e954" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[160fe631-4ebb-47db-bfaa-ae0dcf995d0f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:53 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:53 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:53 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 Jul 08 03:34:53 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:54 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:54 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.058s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:54 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954" returned: 0 in 1.111s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6100283f-a049-4ca7-b548-3ecdc8878d39 tempest-GroupSnapshotsTest-720221876 None] Delete group completed successfully. Jul 08 03:34:54 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954 Jul 08 03:34:54 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:55 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-465183e7-b3ae-4616-92e8-3f9ec774e954" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-quobyte-465183e7-b3ae-4616-92e8-3f9ec774e954" released by "delete_volume" :: held 1.982s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Created reservations ['4691fe7b-d976-4da8-aa20-34c9eff099ee', 'bdfb9618-e799-471f-af9f-dadeb3b07b72', '7c33cb83-4187-40b3-95f8-1eea61e31f91', 'e3b51141-56f3-4aed-9002-ef606ee634e2'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:34:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:34:55 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:34:55 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:34:56 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 08 03:34:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.932s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:34:56 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:34:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Deleted volume successfully. Jul 08 03:34:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ae2784f6-fe38-4609-845e-720c3c48348e tempest-CreateVolumesFromSnapshotTest-855227716 None] Lock "cinder-465183e7-b3ae-4616-92e8-3f9ec774e954-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:05 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=123,cinder:UPDATE=157,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:35:06 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=134,cinder:UPDATE=146,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:35:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6965f376-3a08-4b42-bf0a-7ea8c6053277 tempest-GroupsV314Test-177225989 None] Group tempest-GroupsV314Test-Group-1552355954: creating Jul 08 03:35:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6965f376-3a08-4b42-bf0a-7ea8c6053277 tempest-GroupsV314Test-177225989 None] Group tempest-GroupsV314Test-Group-1552355954: created successfully Jul 08 03:35:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6965f376-3a08-4b42-bf0a-7ea8c6053277 tempest-GroupsV314Test-177225989 None] Create group completed successfully. Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Flow 'volume_create_manager' (9162e112-86f4-4171-b117-d14be031c8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9692e3-0521-4378-a97e-3072ec9569af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9692e3-0521-4378-a97e-3072ec9569af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659794770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5f2a018-5cbb-45c9-a2e5-71d09ff57649,host='devstack@QuobyteHD#QuobyteHD',id=b3b25993-ea45-48f8-9b83-bd2d4c27a3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cb36ae7c3d4466a6c427f4c48adb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:13Z,use_quota=True,user_id='c860409cb3a94b718b055e8123757356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87d00e7-da4e-45b8-923d-772f462c172f),volume_type_id=b87d00e7-da4e-45b8-923d-772f462c172f)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50343669-abf0-434c-8e27-da262c88a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50343669-abf0-434c-8e27-da262c88a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b9a08c-8102-4521-88fa-c0ffadfa3052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b9a08c-8102-4521-88fa-c0ffadfa3052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b25993-ea45-48f8-9b83-bd2d4c27a3ad', 'volume_name': 'volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9567b33-c2bd-4b5a-bbb4-7088b539e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9567b33-c2bd-4b5a-bbb4-7088b539e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e31f1b6-a727-47c6-860c-1fd412a6dbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:12 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Volume b3b25993-ea45-48f8-9b83-bd2d4c27a3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad', 'volume_size': 1} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5f2a018-5cbb-45c9-a2e5-71d09ff57649,created_at=2026-07-08T01:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659794770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5f2a018-5cbb-45c9-a2e5-71d09ff57649,host='devstack@QuobyteHD#QuobyteHD',id=b3b25993-ea45-48f8-9b83-bd2d4c27a3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cb36ae7c3d4466a6c427f4c48adb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:13Z,use_quota=True,user_id='c860409cb3a94b718b055e8123757356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87d00e7-da4e-45b8-923d-772f462c172f),volume_type_id=b87d00e7-da4e-45b8-923d-772f462c172f)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Creating volume b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:12 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:12 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad 1073741824 Jul 08 03:35:12 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:13 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad 1073741824" returned: 0 in 0.934s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:13 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:13 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:14 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 0.709s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e31f1b6-a727-47c6-860c-1fd412a6dbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc56ed4e-76bf-4e8f-a70a-f5205ee51c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:14 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Volume volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad (b3b25993-ea45-48f8-9b83-bd2d4c27a3ad): created successfully Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc56ed4e-76bf-4e8f-a70a-f5205ee51c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Flow 'volume_create_manager' (9162e112-86f4-4171-b117-d14be031c8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f007ee59-804a-439f-9e69-5c6ee36b7eb5 tempest-GroupsV314Test-177225989 None] Created volume successfully. Jul 08 03:35:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:16 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Cloning volume b3b25993-ea45-48f8-9b83-bd2d4c27a3ad to volume c8f7b89c-2b36-4066-ae57-98101258eaf8 Jul 08 03:35:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Creating offline snapshot d967321e-0224-4acb-a3b6-933ee1d07f4c of volume b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:35:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[848a6214-4ba1-4ce2-bb61-691d7c83f659]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:16 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:16 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:17 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 0.977s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:17 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c 1G Jul 08 03:35:17 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:18 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c 1G" returned: 0 in 0.960s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:18 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c Jul 08 03:35:18 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:18 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c" returned: 0 in 0.750s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:18 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:35:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:18 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c Jul 08 03:35:18 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:19 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c" returned: 0 in 0.839s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:19 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info Jul 08 03:35:19 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:20 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info" returned: 0 in 0.853s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:20 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:35:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:20 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info Jul 08 03:35:20 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:21 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.info" returned: 0 in 0.720s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Acquiring lock "cinder-quobyte-c8f7b89c-2b36-4066-ae57-98101258eaf8" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-c8f7b89c-2b36-4066-ae57-98101258eaf8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] snapshot: d967321e-0224-4acb-a3b6-933ee1d07f4c, volume: c8f7b89c-2b36-4066-ae57-98101258eaf8, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b59992-d185-46d3-a649-126adba53034]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:21 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c Jul 08 03:35:21 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:23 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c" returned: 0 in 1.502s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d1a7d3-3db3-4e47-8472-6b9d36561a02]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:23 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:23 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:23 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 0.956s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:35:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:24 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 Jul 08 03:35:24 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (13a62558-fe3d-46a1-97d2-5d215786cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2012f7-505f-4c5a-8fb5-11fd302f04bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2012f7-505f-4c5a-8fb5-11fd302f04bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053939804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7773fbe4-9ca6-49a5-b476-d6050cc84c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:25Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b58f21-d912-40d2-a3d7-5035979e4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b58f21-d912-40d2-a3d7-5035979e4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17de7d3-5cbe-4a09-bf0a-3dd132a9d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17de7d3-5cbe-4a09-bf0a-3dd132a9d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7773fbe4-9ca6-49a5-b476-d6050cc84c75', 'volume_name': 'volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40ecb4-561f-4983-8258-a77f45f797eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40ecb4-561f-4983-8258-a77f45f797eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644d250b-a4f5-4f0a-913d-e6416dd3383a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Volume 7773fbe4-9ca6-49a5-b476-d6050cc84c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75', 'volume_size': 1} Jul 08 03:35:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:33 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8" returned: 0 in 9.475s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:33 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[877116b2-1739-4c01-b576-6984b850b5a2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:33 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:33 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:34 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 1.203s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:34 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad, size 1024.00 MB, duration 9.48 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:35:34 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Converted 1024.00 MB image at 108.05 MB/s Jul 08 03:35:34 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 03:35:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:34 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 Jul 08 03:35:34 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:35 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8" returned: 0 in 0.694s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-c8f7b89c-2b36-4066-ae57-98101258eaf8" released by "_copy_volume_from_snapshot" :: held 13.917s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Acquiring lock "cinder-quobyte-d967321e-0224-4acb-a3b6-933ee1d07f4c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-d967321e-0224-4acb-a3b6-933ee1d07f4c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Deleting offline snapshot d967321e-0224-4acb-a3b6-933ee1d07f4c of volume b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] snapshot_file for this snap is: volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef7ee6-cc1a-4252-a9d8-6d30985c567d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:35 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c Jul 08 03:35:35 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:35 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:35:36 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c" returned: 0 in 0.806s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:35:36 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a725d2b1-8a9a-4c25-8f84-44fb551c6a1e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:36 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:36 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:37 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:37 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c Jul 08 03:35:37 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:37 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c" returned: 0 in 0.743s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:37 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c Jul 08 03:35:37 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:38 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad.d967321e-0224-4acb-a3b6-933ee1d07f4c" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-d967321e-0224-4acb-a3b6-933ee1d07f4c" released by "_delete_snapshot" :: held 3.068s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.311s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.519s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1053939804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7773fbe4-9ca6-49a5-b476-d6050cc84c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:25Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Creating volume 7773fbe4-9ca6-49a5-b476-d6050cc84c75 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:38 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 1073741824 Jul 08 03:35:38 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5158fba4-dbc5-4a74-8b8e-cc2445953ad1 tempest-GroupsV314Test-177225989 None] Create group from source-group-e5f2a018-5cbb-45c9-a2e5-71d09ff57649 completed successfully. Jul 08 03:35:39 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 1073741824" returned: 0 in 0.924s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:39 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 Jul 08 03:35:39 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:40 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644d250b-a4f5-4f0a-913d-e6416dd3383a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13c34c9-4d39-4fd7-8f5d-b41d500a299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Volume volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 (7773fbe4-9ca6-49a5-b476-d6050cc84c75): created successfully Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13c34c9-4d39-4fd7-8f5d-b41d500a299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (13a62558-fe3d-46a1-97d2-5d215786cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8e5036b5-4b52-4ae1-9257-431894437bae tempest-VolumesActionsTest-235615261 None] Created volume successfully. Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Acquiring lock "cinder-quobyte-c8f7b89c-2b36-4066-ae57-98101258eaf8" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-c8f7b89c-2b36-4066-ae57-98101258eaf8" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1fa46e-5cef-4bcf-b567-e816d05a2260]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:40 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 Jul 08 03:35:40 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-88474e80-5a9d-4f33-9497-6dd21ff00482 tempest-VolumesActionsTest-235615261 None] Acquiring lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75" by "attach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-88474e80-5a9d-4f33-9497-6dd21ff00482 tempest-VolumesActionsTest-235615261 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75" acquired by "attach_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-88474e80-5a9d-4f33-9497-6dd21ff00482 tempest-VolumesActionsTest-235615261 None] Attaching volume 7773fbe4-9ca6-49a5-b476-d6050cc84c75 to instance 449eccd8-5cb9-4211-93e5-8a9ee4f46c74 at mountpoint /dev/vdb on host None. Jul 08 03:35:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-88474e80-5a9d-4f33-9497-6dd21ff00482 tempest-VolumesActionsTest-235615261 None] Attach volume completed successfully. Jul 08 03:35:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-88474e80-5a9d-4f33-9497-6dd21ff00482 tempest-VolumesActionsTest-235615261 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75" released by "attach_volume" :: held 0.101s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:41 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:41 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8 Jul 08 03:35:41 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:41 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5449560f-0448-4a5e-89d6-9e1b36c299e1 tempest-VolumesActionsTest-1250890963 None] Terminate volume connection completed successfully. Jul 08 03:35:41 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f7b89c-2b36-4066-ae57-98101258eaf8" returned: 0 in 0.660s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-c8f7b89c-2b36-4066-ae57-98101258eaf8" released by "delete_volume" :: held 1.480s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Created reservations ['f77d1df2-52be-422a-a621-1db8d992ffa3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:41 devstack cinder-volume[86294]: WARNING cinder.quota [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2142365368 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2142365368, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:35:41 devstack cinder-volume[86294]: WARNING cinder.quota [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2142365368 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2142365368, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Created reservations ['7a95fc40-270a-4225-810a-22019a845a4e', '21cae7d8-5d2f-4883-a076-1dfbaa149219', '156c91d3-164f-4302-890a-c9c56c5151cd', '7a500f60-efe5-46c4-97a2-529b7287fbb9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:41 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:35:41 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5449560f-0448-4a5e-89d6-9e1b36c299e1 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-detach_volume" by "detach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5449560f-0448-4a5e-89d6-9e1b36c299e1 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5449560f-0448-4a5e-89d6-9e1b36c299e1 tempest-VolumesActionsTest-1250890963 None] Detaching volume 7773fbe4-9ca6-49a5-b476-d6050cc84c75 from instance 449eccd8-5cb9-4211-93e5-8a9ee4f46c74. Jul 08 03:35:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5449560f-0448-4a5e-89d6-9e1b36c299e1 tempest-VolumesActionsTest-1250890963 None] Detach volume completed successfully. Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5449560f-0448-4a5e-89d6-9e1b36c299e1 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:42 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.655s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:35:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-04195847-3528-457e-a502-9ba0a3ae800c tempest-GroupsV314Test-177225989 None] Delete group completed successfully. Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f00739e-9946-4b08-bed2-060369ece745 tempest-VolumesActionsTest-235615261 None] Acquiring lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-detach_volume" by "detach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f00739e-9946-4b08-bed2-060369ece745 tempest-VolumesActionsTest-235615261 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2f00739e-9946-4b08-bed2-060369ece745 tempest-VolumesActionsTest-235615261 None] Volume detach called, but volume not attached. Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f00739e-9946-4b08-bed2-060369ece745 tempest-VolumesActionsTest-235615261 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Acquiring lock "cinder-quobyte-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0484ce-f061-45a3-a659-3650f7429b32]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:43 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:43 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Acquiring lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Acquiring lock "cinder-quobyte-7773fbe4-9ca6-49a5-b476-d6050cc84c75" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Lock "cinder-quobyte-7773fbe4-9ca6-49a5-b476-d6050cc84c75" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b2fba-6649-4cab-912f-eeb9a799a4bf]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:43 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 Jul 08 03:35:43 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:43 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 0.879s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:43 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad Jul 08 03:35:43 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:44 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75" returned: 0 in 0.869s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:44 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75 Jul 08 03:35:44 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:44 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" returned: 0 in 0.701s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Lock "cinder-quobyte-b3b25993-ea45-48f8-9b83-bd2d4c27a3ad" released by "delete_volume" :: held 1.664s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Created reservations ['4b158d71-c24f-4e53-96af-d126d7de3e3e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Created reservations ['92848482-55ee-4a6f-ac0d-b5b1545ae902', '2481797b-9545-4852-8d53-cb70e37be22e', '6b1585f6-1ce7-4c00-bcf9-bb27bed081ed', '965d4866-a854-4a90-b5ea-7ced587c227b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:44 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:35:44 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:45 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7773fbe4-9ca6-49a5-b476-d6050cc84c75" returned: 0 in 0.669s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Lock "cinder-quobyte-7773fbe4-9ca6-49a5-b476-d6050cc84c75" released by "delete_volume" :: held 1.586s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Created reservations ['f9e5f51f-b07a-42d4-bc01-aea5e678e3f1', '1225431a-4e36-4f3a-a6e7-0917ed7dde12', '903ee30d-65dc-4bd0-ad65-ccf9bd60ac2c', '6bb4d6e7-0377-4afa-a7fe-5bb7fc3d58cb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:45 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:35:45 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:45 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:35:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-182404cf-55f0-4fd8-8032-1e06804a2d9c tempest-GroupsV314Test-177225989 None] Delete group completed successfully. Jul 08 03:35:45 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:35:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Deleted volume successfully. Jul 08 03:35:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f737afe7-a58e-43f8-bd9e-c8ba41ca9bcc tempest-VolumesActionsTest-235615261 None] Lock "cinder-7773fbe4-9ca6-49a5-b476-d6050cc84c75-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:47 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:35:47 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:47 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.932s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:35:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:35:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:35:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Flow 'volume_create_manager' (47489561-ffc5-4ff6-b3c6-a75411c2a1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1299242e-6cb0-46ba-8191-0865aa1ba451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1299242e-6cb0-46ba-8191-0865aa1ba451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1631222092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ddab66-5cf3-4637-86c4-0efab3102cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e450dc5cc4944892b3336e914e1b93a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:52Z,use_quota=True,user_id='757b6cd588ec4500949383c509a36059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dd8f89-1fe8-4382-aec8-cc9d5324c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dd8f89-1fe8-4382-aec8-cc9d5324c254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f3794e-e34e-4e3d-a504-e44adef3d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f3794e-e34e-4e3d-a504-e44adef3d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ddab66-5cf3-4637-86c4-0efab3102cd8', 'volume_name': 'volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83238ca9-a788-47f0-9f66-1c9a4b6c7335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83238ca9-a788-47f0-9f66-1c9a4b6c7335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87769971-0599-4484-a9fa-2002057a96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Volume b4ddab66-5cf3-4637-86c4-0efab3102cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8', 'volume_size': 1} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1631222092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ddab66-5cf3-4637-86c4-0efab3102cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e450dc5cc4944892b3336e914e1b93a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:52Z,use_quota=True,user_id='757b6cd588ec4500949383c509a36059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Creating volume b4ddab66-5cf3-4637-86c4-0efab3102cd8 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:52 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:52 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 1073741824 Jul 08 03:35:52 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:53 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 1073741824" returned: 0 in 0.910s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:53 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 Jul 08 03:35:53 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (e6e37f70-ebb7-462f-a686-24a458491e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535fb7a6-42f5-4ad5-9a50-df2283cb4edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535fb7a6-42f5-4ad5-9a50-df2283cb4edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1778511052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c11e084-1246-42ce-a390-05635e14ce24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:53Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060607be-9511-4192-8336-21b42a72be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060607be-9511-4192-8336-21b42a72be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82123779-b3b7-4ded-8ad1-67dc6d13cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82123779-b3b7-4ded-8ad1-67dc6d13cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c11e084-1246-42ce-a390-05635e14ce24', 'volume_name': 'volume-4c11e084-1246-42ce-a390-05635e14ce24', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a9a323-7270-435c-86a1-22a4cfc65f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a9a323-7270-435c-86a1-22a4cfc65f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0a77c2-b886-4405-aca0-495b6f8feb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Volume 4c11e084-1246-42ce-a390-05635e14ce24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c11e084-1246-42ce-a390-05635e14ce24', 'volume_size': 1} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Flow 'volume_create_manager' (6b902173-45a7-4a9f-8794-e9962d868aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014de7a8-c898-42db-8960-1a4905484473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014de7a8-c898-42db-8960-1a4905484473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-263113176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872e2e7f-45c8-40da-8e7c-8cbea5a064d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc67961694f0459aa724e2df0053e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:54Z,use_quota=True,user_id='4d903f02cb304be68b24218c9337293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3acc867-16e3-4986-85a9-6934da2caa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3acc867-16e3-4986-85a9-6934da2caa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e735f5b8-fe2f-409d-872c-9a8752dd0c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e735f5b8-fe2f-409d-872c-9a8752dd0c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872e2e7f-45c8-40da-8e7c-8cbea5a064d4', 'volume_name': 'volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c17c709-71be-4b31-832c-7809d9e31995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c17c709-71be-4b31-832c-7809d9e31995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a7db43-3289-4b21-90ae-e4c0213026c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Volume 872e2e7f-45c8-40da-8e7c-8cbea5a064d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4', 'volume_size': 1} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:53 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8" returned: 0 in 0.655s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1778511052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c11e084-1246-42ce-a390-05635e14ce24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:53Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Creating volume 4c11e084-1246-42ce-a390-05635e14ce24 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:53 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:53 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 1073741824 Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87769971-0599-4484-a9fa-2002057a96d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4868cf-e95a-443c-bb21-dc1d4ee02cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Volume volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 (b4ddab66-5cf3-4637-86c4-0efab3102cd8): created successfully Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4868cf-e95a-443c-bb21-dc1d4ee02cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Flow 'volume_create_manager' (47489561-ffc5-4ff6-b3c6-a75411c2a1cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9b0e7439-6b09-4753-9ac0-9bbabdfd104e tempest-VolumeQuotasAdminTestJSON-707271344 None] Created volume successfully. Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "cinder-b4ddab66-5cf3-4637-86c4-0efab3102cd8-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "cinder-b4ddab66-5cf3-4637-86c4-0efab3102cd8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "cinder-quobyte-b4ddab66-5cf3-4637-86c4-0efab3102cd8" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "cinder-quobyte-b4ddab66-5cf3-4637-86c4-0efab3102cd8" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaaca79-c745-4e44-a918-ec147c1a21c3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:54 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 Jul 08 03:35:54 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:54 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 1073741824" returned: 0 in 0.836s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:54 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 Jul 08 03:35:54 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:55 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:55 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8 Jul 08 03:35:55 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:55 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-263113176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872e2e7f-45c8-40da-8e7c-8cbea5a064d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc67961694f0459aa724e2df0053e3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:54Z,use_quota=True,user_id='4d903f02cb304be68b24218c9337293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Creating volume 872e2e7f-45c8-40da-8e7c-8cbea5a064d4 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:55 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:55 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 1073741824 Jul 08 03:35:55 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0a77c2-b886-4405-aca0-495b6f8feb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c11e084-1246-42ce-a390-05635e14ce24', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4437cdb-6a75-4277-9b82-e5b3ff275db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:55 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Volume volume-4c11e084-1246-42ce-a390-05635e14ce24 (4c11e084-1246-42ce-a390-05635e14ce24): created successfully Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4437cdb-6a75-4277-9b82-e5b3ff275db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (e6e37f70-ebb7-462f-a686-24a458491e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-64819527-ceea-47de-9c8f-9200a149aca4 tempest-VolumesActionsTest-235615261 None] Created volume successfully. Jul 08 03:35:55 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b4ddab66-5cf3-4637-86c4-0efab3102cd8" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "cinder-quobyte-b4ddab66-5cf3-4637-86c4-0efab3102cd8" released by "delete_volume" :: held 1.451s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Created reservations ['12f5267e-f7af-478e-ae0b-98eb38ba586e', '82085e0e-1b7f-48f2-8880-ef639f20a132', '0741e495-9416-40a1-a4d8-e55f7cbd7bb9', '1024d101-f565-4e11-a5a2-2e36697712cb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:56 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:35:56 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:56 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 1073741824" returned: 0 in 0.825s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:56 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 Jul 08 03:35:56 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-4c11e084-1246-42ce-a390-05635e14ce24-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-4c11e084-1246-42ce-a390-05635e14ce24-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:56 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:35:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Deleted volume successfully. Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bccae924-93a1-4e8d-907f-709838faa340 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "cinder-b4ddab66-5cf3-4637-86c4-0efab3102cd8-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-quobyte-4c11e084-1246-42ce-a390-05635e14ce24" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-4c11e084-1246-42ce-a390-05635e14ce24" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd600889-20af-49cc-afbc-93619a84f90d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:35:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:57 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 Jul 08 03:35:57 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:57 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" returned: 0 in 0.755s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a7db43-3289-4b21-90ae-e4c0213026c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0d99fe-79c0-4ddb-9e31-3d88f31e7336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Volume volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 (872e2e7f-45c8-40da-8e7c-8cbea5a064d4): created successfully Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0d99fe-79c0-4ddb-9e31-3d88f31e7336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Flow 'volume_create_manager' (6b902173-45a7-4a9f-8794-e9962d868aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-48feb1a8-6c6d-4543-8300-5f8261115129 tempest-AttachVolumeNegativeTest-974566903 None] Created volume successfully. Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Flow 'volume_create_manager' (0d9e271c-8982-493b-b054-ebf1741a99f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1cf720-ba9e-4907-acda-8ee87c45f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1cf720-ba9e-4907-acda-8ee87c45f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-476927014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e450dc5cc4944892b3336e914e1b93a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:57Z,use_quota=True,user_id='757b6cd588ec4500949383c509a36059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aede04c9-ccb9-4af6-bc26-adfb033a0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aede04c9-ccb9-4af6-bc26-adfb033a0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760bb7eb-5e9b-48bf-8a4a-b10bb30f8093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760bb7eb-5e9b-48bf-8a4a-b10bb30f8093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e', 'volume_name': 'volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72abb4ed-d603-46fa-a985-76d63318a734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72abb4ed-d603-46fa-a985-76d63318a734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68577ac-01f5-4cec-81a2-93e06a1e1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Volume f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e', 'volume_size': 1} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-476927014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e450dc5cc4944892b3336e914e1b93a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:57Z,use_quota=True,user_id='757b6cd588ec4500949383c509a36059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Creating volume f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:57 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:57 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e 1073741824 Jul 08 03:35:57 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:57 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24" returned: 0 in 0.919s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:57 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24 Jul 08 03:35:57 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:58 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e 1073741824" returned: 0 in 0.863s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:58 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e Jul 08 03:35:58 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:58 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4c11e084-1246-42ce-a390-05635e14ce24" returned: 0 in 0.692s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-4c11e084-1246-42ce-a390-05635e14ce24" released by "delete_volume" :: held 1.665s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Created reservations ['7409e42b-b52e-424b-b623-7f48dde3bd9e', '1deeb286-2fce-4236-8073-a39531426f7a', '57c2a949-f158-4e20-9e5f-fb8ebfefe2ab', '2b3f601b-e71e-4d6f-98ed-f49e6b0b30ae'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:58 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:35:58 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:35:59 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e" returned: 0 in 0.710s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68577ac-01f5-4cec-81a2-93e06a1e1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdf98e2-a821-4295-b95f-7480285ce305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Volume volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e (f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e): created successfully Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdf98e2-a821-4295-b95f-7480285ce305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Flow 'volume_create_manager' (0d9e271c-8982-493b-b054-ebf1741a99f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e4c92ea0-f533-43da-a200-6a01bb7ac091 tempest-VolumeQuotasAdminTestJSON-707271344 None] Created volume successfully. Jul 08 03:35:59 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:35:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Deleted volume successfully. Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1bc5fc38-9d7c-45d2-98d8-c80b3988c543 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-4c11e084-1246-42ce-a390-05635e14ce24-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (a1481925-57a6-45e1-886f-18fb66933103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98f128b-0876-41db-8994-9c37ce8a9bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98f128b-0876-41db-8994-9c37ce8a9bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1033073082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e0265c-81df-4dac-a062-633aa884c013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:59Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3d7478-9d4e-482e-a826-309045076b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3d7478-9d4e-482e-a826-309045076b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a326c5-6bd5-4444-bc8b-e65bdfd748a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a326c5-6bd5-4444-bc8b-e65bdfd748a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e0265c-81df-4dac-a062-633aa884c013', 'volume_name': 'volume-97e0265c-81df-4dac-a062-633aa884c013', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db958088-5b32-423a-8514-8cd2cbda6698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db958088-5b32-423a-8514-8cd2cbda6698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78974874-d269-4662-acc4-0fbd0be016cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:35:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Volume 97e0265c-81df-4dac-a062-633aa884c013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e0265c-81df-4dac-a062-633aa884c013', 'volume_size': 1} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1033073082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e0265c-81df-4dac-a062-633aa884c013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:35:59Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Creating volume 97e0265c-81df-4dac-a062-633aa884c013 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:35:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:35:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:35:59 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 1073741824 Jul 08 03:35:59 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:00 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a2a2002f-5f21-4b4f-817b-34a29f1ca0d7 tempest-VolumeQuotasAdminTestJSON-290737239 None] Transfer volume completed successfully. Jul 08 03:36:00 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 1073741824" returned: 0 in 0.844s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:00 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 Jul 08 03:36:00 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Acquiring lock "cinder-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Lock "cinder-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Acquiring lock "cinder-quobyte-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Lock "cinder-quobyte-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3cd01-2569-44d4-8096-ef6cd85ddf2b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:01 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013" returned: 0 in 0.711s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.352s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78974874-d269-4662-acc4-0fbd0be016cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e0265c-81df-4dac-a062-633aa884c013', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e8f9b2-d3fc-4a9c-aa4e-a1af6f9489ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c8b0dd-f6b1-4ae2-b75d-974eaf68eef7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:01 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e Jul 08 03:36:01 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Volume volume-97e0265c-81df-4dac-a062-633aa884c013 (97e0265c-81df-4dac-a062-633aa884c013): created successfully Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e8f9b2-d3fc-4a9c-aa4e-a1af6f9489ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (a1481925-57a6-45e1-886f-18fb66933103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-64302e56-2e8f-4c69-953c-54b1a7fc0212 tempest-VolumesActionsTest-235615261 None] Created volume successfully. Jul 08 03:36:01 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 Jul 08 03:36:01 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-97e0265c-81df-4dac-a062-633aa884c013-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:01 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e" returned: 0 in 0.828s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-97e0265c-81df-4dac-a062-633aa884c013-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:02 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e Jul 08 03:36:02 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:02 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" returned: 0 in 0.800s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-quobyte-97e0265c-81df-4dac-a062-633aa884c013" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-97e0265c-81df-4dac-a062-633aa884c013" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d24b17c-23b5-41d1-b51b-04ccc85b8a56', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb111249-ba18-4334-9933-8a2288699fab]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-8dafd901-6522-4561-8f43-32bfeb3e4f3c req-625cf49b-db52-4e6b-9000-d8212e7050b1 tempest-AttachVolumeNegativeTest-974566903 None] attachment_update completed successfully. Jul 08 03:36:02 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 Jul 08 03:36:02 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:02 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e" returned: 0 in 0.744s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Lock "cinder-quobyte-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e" released by "delete_volume" :: held 1.607s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Created reservations ['7f77d640-e971-4cd2-a7d9-067e5c4662c4', '0fbfe31e-13ba-49d8-b8c0-f213a6fe61dc', 'd46d0878-98c5-4f27-a091-bf23f0414425', '3e6d531c-ea28-42ad-bdd1-d8692b2452ab'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:02 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:02 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:02 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013" returned: 0 in 0.821s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:02 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013 Jul 08 03:36:02 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:03 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:03 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Deleted volume successfully. Jul 08 03:36:03 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-97e0265c-81df-4dac-a062-633aa884c013" returned: 0 in 0.712s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-87cc6ca6-aa21-4511-b895-06f2a7d3dc3c tempest-VolumeQuotasAdminTestJSON-775516934 None] Lock "cinder-f56f2dcf-7a9f-41fe-a0c2-8f8b3b90fe1e-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-97e0265c-81df-4dac-a062-633aa884c013" released by "delete_volume" :: held 1.594s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Created reservations ['579f9d7f-3740-4cf0-849f-d267b2806cee', '768482fe-cc71-4367-96a3-302ee700a246', '079bfc55-fa86-4d5c-9759-44a64090d1db', '3545ac6b-df4b-4a43-b400-b8a2bdf0db0c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:03 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:03 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:04 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.693s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Deleted volume successfully. Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4f122326-6484-43e2-aa83-d3aeb33db112 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-97e0265c-81df-4dac-a062-633aa884c013-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (f3c34c73-9025-40c9-ac71-24a1342bd335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71fd9cf-3b6a-4f62-8a95-6121bb9f9362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71fd9cf-3b6a-4f62-8a95-6121bb9f9362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-668292159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae46ff5-0ebb-455c-b412-90d1b32a5768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:05Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006d7dcc-9aff-4411-b2dd-303154cadf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006d7dcc-9aff-4411-b2dd-303154cadf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdc4b7a-cf2b-404c-bf2f-67fb2da7a9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdc4b7a-cf2b-404c-bf2f-67fb2da7a9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae46ff5-0ebb-455c-b412-90d1b32a5768', 'volume_name': 'volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd321716-8534-4f86-9245-97cb89b3e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd321716-8534-4f86-9245-97cb89b3e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdf53d8-7ccf-4fe5-99e1-1aa852a504be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:04 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Volume 6ae46ff5-0ebb-455c-b412-90d1b32a5768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768', 'volume_size': 1} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-668292159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae46ff5-0ebb-455c-b412-90d1b32a5768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:05Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Creating volume 6ae46ff5-0ebb-455c-b412-90d1b32a5768 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:04 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:04 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 1073741824 Jul 08 03:36:04 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:05 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 1073741824" returned: 0 in 0.938s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:05 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 Jul 08 03:36:05 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:06 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdf53d8-7ccf-4fe5-99e1-1aa852a504be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab98a60-ff8d-42e5-83c5-857ba04bd656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=78,cinder:UPDATE=101,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:36:06 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Volume volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 (6ae46ff5-0ebb-455c-b412-90d1b32a5768): created successfully Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab98a60-ff8d-42e5-83c5-857ba04bd656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (f3c34c73-9025-40c9-ac71-24a1342bd335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-23bf64bd-296f-4a3b-88f4-1b3275ca1d92 tempest-VolumesActionsTest-235615261 None] Created volume successfully. Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-6ae46ff5-0ebb-455c-b412-90d1b32a5768-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Lock "cinder-6ae46ff5-0ebb-455c-b412-90d1b32a5768-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-quobyte-6ae46ff5-0ebb-455c-b412-90d1b32a5768" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-6ae46ff5-0ebb-455c-b412-90d1b32a5768" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afe18e9-ac61-4058-b231-74b5a69ff097]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:07 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 Jul 08 03:36:07 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:07 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768" returned: 0 in 0.828s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:07 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768 Jul 08 03:36:07 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:08 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6ae46ff5-0ebb-455c-b412-90d1b32a5768" returned: 0 in 0.680s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-6ae46ff5-0ebb-455c-b412-90d1b32a5768" released by "delete_volume" :: held 1.563s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-92039102-109f-4ab2-84d6-ce5b04a14dd3 req-e387cdd5-5f59-454b-8d8c-2a32346a6f7c tempest-AttachVolumeNegativeTest-974566903 None] Terminate volume connection completed successfully. Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-92039102-109f-4ab2-84d6-ce5b04a14dd3 req-e387cdd5-5f59-454b-8d8c-2a32346a6f7c tempest-AttachVolumeNegativeTest-974566903 None] Deleting attachment 4d24b17c-23b5-41d1-b51b-04ccc85b8a56. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Created reservations ['f32f0963-d6b9-4b21-9a6a-ce9fa0238ba6', '56b22f34-97db-4a50-9494-247bc8525fb5', '47dec044-d7fe-46f5-9138-a66c051d095a', '6a122d71-a2c0-488d-a52d-5f7cb237063f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:08 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:08 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:09 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:09 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Deleted volume successfully. Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-469457e9-a8cf-4782-8970-21f8d0aad0dc tempest-VolumesActionsTest-1250890963 None] Lock "cinder-6ae46ff5-0ebb-455c-b412-90d1b32a5768-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (3b65aa0b-46ad-4665-80c5-8c31fe2a6894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7adb03-e26e-4d7d-8993-1700a69cf5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7adb03-e26e-4d7d-8993-1700a69cf5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439446168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e8e902-ff6f-443e-909e-cc7de9d63118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:10Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64a2239-982c-4f5b-9d50-0017032e8366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64a2239-982c-4f5b-9d50-0017032e8366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b37084-7b31-497a-9eec-82712f489db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b37084-7b31-497a-9eec-82712f489db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e8e902-ff6f-443e-909e-cc7de9d63118', 'volume_name': 'volume-49e8e902-ff6f-443e-909e-cc7de9d63118', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b62829-449d-43d1-a820-6e4434eb6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b62829-449d-43d1-a820-6e4434eb6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5488eedd-9f30-4756-ab58-918c0cc7d397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:09 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Volume 49e8e902-ff6f-443e-909e-cc7de9d63118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e8e902-ff6f-443e-909e-cc7de9d63118', 'volume_size': 1} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439446168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e8e902-ff6f-443e-909e-cc7de9d63118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:10Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Creating volume 49e8e902-ff6f-443e-909e-cc7de9d63118 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:09 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:09 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 1073741824 Jul 08 03:36:09 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Flow 'volume_create_manager' (c99e4eaa-6d03-470f-8408-d134484d42f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb734507-2200-4bfa-b823-7037b60adb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb734507-2200-4bfa-b823-7037b60adb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-711192683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8309af-ee6a-42f6-a63c-79893ef6f0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59fa70acae5458f81cefb97c6de8b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:11Z,use_quota=True,user_id='b1aeecd56a7b4019a5843b450e3e014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e443d7-c8ea-4606-9376-171736b16525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e443d7-c8ea-4606-9376-171736b16525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca4cb51-9650-4813-9cd7-04b19a2bb143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca4cb51-9650-4813-9cd7-04b19a2bb143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8309af-ee6a-42f6-a63c-79893ef6f0c6', 'volume_name': 'volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28703d6f-a276-4d6a-9621-879e95825dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28703d6f-a276-4d6a-9621-879e95825dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a67e5c7-edf0-4bab-83aa-a000be7f77f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:10 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Volume fb8309af-ee6a-42f6-a63c-79893ef6f0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6', 'volume_size': 1} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:10 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 1073741824" returned: 0 in 0.931s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:10 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 Jul 08 03:36:10 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:11 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-711192683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8309af-ee6a-42f6-a63c-79893ef6f0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59fa70acae5458f81cefb97c6de8b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:11Z,use_quota=True,user_id='b1aeecd56a7b4019a5843b450e3e014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Creating volume fb8309af-ee6a-42f6-a63c-79893ef6f0c6 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:11 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:11 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 1073741824 Jul 08 03:36:11 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5488eedd-9f30-4756-ab58-918c0cc7d397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e8e902-ff6f-443e-909e-cc7de9d63118', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e6d42c-f4f3-47f6-b06e-94f076516cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:11 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Volume volume-49e8e902-ff6f-443e-909e-cc7de9d63118 (49e8e902-ff6f-443e-909e-cc7de9d63118): created successfully Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e6d42c-f4f3-47f6-b06e-94f076516cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (3b65aa0b-46ad-4665-80c5-8c31fe2a6894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f3360b3b-d5fe-460b-8279-b813ad4140b7 tempest-VolumesActionsTest-235615261 None] Created volume successfully. Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-49e8e902-ff6f-443e-909e-cc7de9d63118-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-49e8e902-ff6f-443e-909e-cc7de9d63118-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "cinder-quobyte-49e8e902-ff6f-443e-909e-cc7de9d63118" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-49e8e902-ff6f-443e-909e-cc7de9d63118" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9aa092-bdda-4600-ab08-167365d4b705]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:12 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 Jul 08 03:36:12 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:12 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 1073741824" returned: 0 in 0.929s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:12 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 Jul 08 03:36:12 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:13 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118" returned: 0 in 0.929s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:13 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118 Jul 08 03:36:13 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:13 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6" returned: 0 in 0.922s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a67e5c7-edf0-4bab-83aa-a000be7f77f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3d4b83-b8be-433a-9c16-53e2dc38cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:13 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Volume volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 (fb8309af-ee6a-42f6-a63c-79893ef6f0c6): created successfully Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3d4b83-b8be-433a-9c16-53e2dc38cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Flow 'volume_create_manager' (c99e4eaa-6d03-470f-8408-d134484d42f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fbb8f168-4366-43f5-8e3b-3f74918680b2 tempest-VolumesServicesTestJSON-2017577566 None] Created volume successfully. Jul 08 03:36:13 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-49e8e902-ff6f-443e-909e-cc7de9d63118" returned: 0 in 0.804s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-quobyte-49e8e902-ff6f-443e-909e-cc7de9d63118" released by "delete_volume" :: held 1.794s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Acquiring lock "cinder-fb8309af-ee6a-42f6-a63c-79893ef6f0c6-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Lock "cinder-fb8309af-ee6a-42f6-a63c-79893ef6f0c6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Acquiring lock "cinder-quobyte-fb8309af-ee6a-42f6-a63c-79893ef6f0c6" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Created reservations ['2767939d-bd22-44e7-8a64-3e38a71b7cfb', '455ce923-7f3a-4e4c-9f28-37ec1a9b0555', 'a0970ee2-93df-4147-8aca-fcfdf8dc35b6', '3dae2768-a31d-4f26-b86d-6f79e216098a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Lock "cinder-quobyte-fb8309af-ee6a-42f6-a63c-79893ef6f0c6" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[944281ac-4407-478b-8bc0-080cf14a8c9b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:14 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:14 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:14 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 Jul 08 03:36:14 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:14 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.733s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Deleted volume successfully. Jul 08 03:36:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-21fc562d-728a-4777-a790-9140e3c35856 tempest-VolumesActionsTest-1250890963 None] Lock "cinder-49e8e902-ff6f-443e-909e-cc7de9d63118-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:15 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (aa1c9798-a645-470d-80dc-c7e547fad805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd22eaf-53c9-4236-bfb8-20c3aa818add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6" returned: 0 in 0.936s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd22eaf-53c9-4236-bfb8-20c3aa818add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986124902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed93b34-c947-4483-b053-ad9d80efaf1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:15Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:15 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6 Jul 08 03:36:15 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c61efd-85d7-4087-a6ce-efaf3f5432c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c61efd-85d7-4087-a6ce-efaf3f5432c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564c9e5b-a0c1-4109-8376-30288d41c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564c9e5b-a0c1-4109-8376-30288d41c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed93b34-c947-4483-b053-ad9d80efaf1a', 'volume_name': 'volume-4ed93b34-c947-4483-b053-ad9d80efaf1a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b10200-f77c-4ac9-b391-038ce47a0852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b10200-f77c-4ac9-b391-038ce47a0852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b581f321-2b28-4a83-b2ef-04595aec9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Volume 4ed93b34-c947-4483-b053-ad9d80efaf1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed93b34-c947-4483-b053-ad9d80efaf1a', 'volume_size': 1} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986124902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed93b34-c947-4483-b053-ad9d80efaf1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951ab897dee64aa9bdd9bcc6c99bce23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:15Z,use_quota=True,user_id='eda94e9e234d4d40b9c1cc2fe897f27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Creating volume 4ed93b34-c947-4483-b053-ad9d80efaf1a {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:15 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:15 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a 1073741824 Jul 08 03:36:15 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:15 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-fb8309af-ee6a-42f6-a63c-79893ef6f0c6" returned: 0 in 0.673s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Lock "cinder-quobyte-fb8309af-ee6a-42f6-a63c-79893ef6f0c6" released by "delete_volume" :: held 1.653s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Created reservations ['2e46e467-ce1c-4208-b1b0-b8af5e703f92', 'c35b0523-7abc-442b-8a7c-9d75d1d08d7a', 'da1fbbe8-613e-4c7c-9441-4c07d39c9ba8', '816eea78-fc66-4390-b508-40d9c02b397e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:15 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:15 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:16 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a 1073741824" returned: 0 in 0.923s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:16 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a Jul 08 03:36:16 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:16 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Deleted volume successfully. Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97204ac1-32dc-4e73-b495-6857351231a8 tempest-VolumesServicesTestJSON-2017577566 None] Lock "cinder-fb8309af-ee6a-42f6-a63c-79893ef6f0c6-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:16 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a" returned: 0 in 0.705s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b581f321-2b28-4a83-b2ef-04595aec9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed93b34-c947-4483-b053-ad9d80efaf1a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8d002c-14bb-4b12-8f26-33cfd919529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Volume volume-4ed93b34-c947-4483-b053-ad9d80efaf1a (4ed93b34-c947-4483-b053-ad9d80efaf1a): created successfully Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8d002c-14bb-4b12-8f26-33cfd919529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Flow 'volume_create_manager' (aa1c9798-a645-470d-80dc-c7e547fad805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3c322bd4-4380-48f0-ad00-a13258eba14b tempest-VolumesActionsTest-235615261 None] Created volume successfully. Jul 08 03:36:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Acquiring lock "cinder-4ed93b34-c947-4483-b053-ad9d80efaf1a-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Lock "cinder-4ed93b34-c947-4483-b053-ad9d80efaf1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Acquiring lock "cinder-quobyte-4ed93b34-c947-4483-b053-ad9d80efaf1a" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Lock "cinder-quobyte-4ed93b34-c947-4483-b053-ad9d80efaf1a" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a73db-bafc-4377-9fa4-a70bdb921796]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:17 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a Jul 08 03:36:17 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:18 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:18 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a Jul 08 03:36:18 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "cinder-872e2e7f-45c8-40da-8e7c-8cbea5a064d4-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-872e2e7f-45c8-40da-8e7c-8cbea5a064d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "cinder-quobyte-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:19 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4ed93b34-c947-4483-b053-ad9d80efaf1a" returned: 0 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Lock "cinder-quobyte-4ed93b34-c947-4483-b053-ad9d80efaf1a" released by "delete_volume" :: held 1.628s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-quobyte-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" acquired by "delete_volume" :: waited 0.031s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6b92b-2222-4ac1-ac71-fad64dd6c7bc]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Created reservations ['03cb8a24-59bc-4462-8aff-6cf311607dd1', '3ff9add3-3f16-44a5-bad1-d5cd718f6137', '2b6cd813-6933-44e3-a1bb-55c6c5fa9d80', 'c217c9c4-a4e6-48db-9c6d-66312effb6bb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:19 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 Jul 08 03:36:19 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:19 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:19 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:20 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" returned: 0 in 0.830s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:20 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4 Jul 08 03:36:20 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:20 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.768s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:20 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Deleted volume successfully. Jul 08 03:36:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0bc5499b-6892-4759-95c7-c182d0739b98 tempest-VolumesActionsTest-235615261 None] Lock "cinder-4ed93b34-c947-4483-b053-ad9d80efaf1a-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:21 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" returned: 0 in 0.710s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-quobyte-872e2e7f-45c8-40da-8e7c-8cbea5a064d4" released by "delete_volume" :: held 1.585s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Created reservations ['994dec4c-a570-4900-9f1b-1393f12434f9', '69efaf3b-d9ef-43c1-9929-e0e2b0dc90bc', 'e937c955-2ede-4faf-a246-03cbf759cadc', 'd63da44d-4353-4ac5-816e-40cc55e5b2d5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:21 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:21 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "cinder-0102da55-df93-495f-b07b-5c13665ddbdd-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-0102da55-df93-495f-b07b-5c13665ddbdd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "cinder-quobyte-0102da55-df93-495f-b07b-5c13665ddbdd" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-quobyte-0102da55-df93-495f-b07b-5c13665ddbdd" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:21 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da3bdbd-b0c7-4055-806f-b8ebe277d3a9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Deleted volume successfully. Jul 08 03:36:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0ed3d264-8ca8-498b-a713-428ded9d4a2c tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-872e2e7f-45c8-40da-8e7c-8cbea5a064d4-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:22 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd Jul 08 03:36:22 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:22 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd" returned: 0 in 0.867s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:22 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd Jul 08 03:36:22 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:23 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0102da55-df93-495f-b07b-5c13665ddbdd" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-quobyte-0102da55-df93-495f-b07b-5c13665ddbdd" released by "delete_volume" :: held 1.712s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Created reservations ['5bc43b39-ec9f-4aae-9d80-d4c514a4ad0c', '1c5ebd6e-9592-47d1-b10e-e5805f54f595', 'c18a703c-064a-4ab0-a840-141c2ab1233c', '6f54c1c1-d558-48ca-a634-47d93ac2af13'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:23 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:23 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "cinder-d8f01325-b26e-4880-84ab-a70aa9b32e50-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-d8f01325-b26e-4880-84ab-a70aa9b32e50-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "cinder-quobyte-d8f01325-b26e-4880-84ab-a70aa9b32e50" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-quobyte-d8f01325-b26e-4880-84ab-a70aa9b32e50" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3a96d7-a5ee-46b5-8ea4-fe5382f94856]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:24 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 Jul 08 03:36:24 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:24 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.003s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Deleted volume successfully. Jul 08 03:36:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8dc3496c-6b10-4f4f-b255-631ce8d20087 tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-0102da55-df93-495f-b07b-5c13665ddbdd-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:25 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50" returned: 0 in 0.856s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:25 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50 Jul 08 03:36:25 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:26 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d8f01325-b26e-4880-84ab-a70aa9b32e50" returned: 0 in 0.718s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-quobyte-d8f01325-b26e-4880-84ab-a70aa9b32e50" released by "delete_volume" :: held 1.625s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Created reservations ['ec627557-2d30-4512-8bde-e81a9c370f95', '0d9212e2-69e8-4c14-b02b-bee3fc87b755', '3de3426a-9e3f-4831-8e12-cc60b1dd1c64', 'b1415ceb-5738-4dc2-bdba-5f595a8ba660'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:26 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:26 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:27 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:27 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Deleted volume successfully. Jul 08 03:36:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3cea091a-4800-4cb6-a50a-7aef0bb138ed tempest-AttachVolumeNegativeTest-974566903 None] Lock "cinder-d8f01325-b26e-4880-84ab-a70aa9b32e50-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Flow 'volume_create_manager' (996ece38-bfa0-4ec4-84c7-14abd7921c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a978544e-abc6-4f08-9b6f-55156e8e20f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a978544e-abc6-4f08-9b6f-55156e8e20f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-905934589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7ca276-497c-415e-bbc5-c2774f9a7065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a055c52cd6f4a3eb49a5486eca04ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:35Z,use_quota=True,user_id='090abcf6c70e47b78371c852e1f82003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0092f8f-08fc-425f-aa44-8481df5acf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0092f8f-08fc-425f-aa44-8481df5acf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5992efc-9a58-4d56-8331-022f711f5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5992efc-9a58-4d56-8331-022f711f5056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7ca276-497c-415e-bbc5-c2774f9a7065', 'volume_name': 'volume-ca7ca276-497c-415e-bbc5-c2774f9a7065', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef896ef-9d2f-4c5a-9fc5-992fd7a20cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef896ef-9d2f-4c5a-9fc5-992fd7a20cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873d6c36-1aa6-44aa-bc08-d8fe0097755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Volume ca7ca276-497c-415e-bbc5-c2774f9a7065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7ca276-497c-415e-bbc5-c2774f9a7065', 'volume_size': 1} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-905934589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7ca276-497c-415e-bbc5-c2774f9a7065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a055c52cd6f4a3eb49a5486eca04ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:35Z,use_quota=True,user_id='090abcf6c70e47b78371c852e1f82003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Creating volume ca7ca276-497c-415e-bbc5-c2774f9a7065 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:35 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:35 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 1073741824 Jul 08 03:36:35 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Flow 'volume_create_manager' (103f0764-0132-4e84-85a9-b6c8cf26cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9688554b-437c-4d02-8dab-2b612669e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9688554b-437c-4d02-8dab-2b612669e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-41871906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41459a3-c3f1-4689-a633-3c636f075624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46376fe44f93440caa32ca04aab940a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:36Z,use_quota=True,user_id='7bd98ae184934956821571cc2ff4c9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2cbfb3-ffd5-4123-8149-d3982aaf57c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2cbfb3-ffd5-4123-8149-d3982aaf57c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488cc0ef-dce0-4c58-8561-d8e32382a7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488cc0ef-dce0-4c58-8561-d8e32382a7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41459a3-c3f1-4689-a633-3c636f075624', 'volume_name': 'volume-a41459a3-c3f1-4689-a633-3c636f075624', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c963e247-bc70-4b91-bf34-88ab57acb989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c963e247-bc70-4b91-bf34-88ab57acb989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b963b2aa-8bb7-4fb0-b2fb-184289926a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:35 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Volume a41459a3-c3f1-4689-a633-3c636f075624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41459a3-c3f1-4689-a633-3c636f075624', 'volume_size': 1} Jul 08 03:36:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:36 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 1073741824" returned: 0 in 0.856s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=148,cinder:SELECT=117,cinder:DELETE=12,cinder:INSERT=30 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:36 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 Jul 08 03:36:36 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Flow 'volume_create_manager' (1bb60e0f-3d5e-4715-8c7e-8e06c961ab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67648811-74b7-4f9b-957c-188c2620f54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67648811-74b7-4f9b-957c-188c2620f54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1532262347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c622df2-ab49-4e1e-9fc7-7a48264cedff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4aa8c9f8e4bc9bac9c48d538567eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:37Z,use_quota=True,user_id='c7cd3502ec1343d7893fe5ce477df588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b26070-f9bd-431b-ad57-81ddd3155cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b26070-f9bd-431b-ad57-81ddd3155cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1f9972-9292-4f23-8029-dd9fa6de8533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1f9972-9292-4f23-8029-dd9fa6de8533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c622df2-ab49-4e1e-9fc7-7a48264cedff', 'volume_name': 'volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d22e15-473f-438b-bf2a-6ac88e53f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d22e15-473f-438b-bf2a-6ac88e53f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7201de62-d77b-4d5f-97aa-5bb16ddc1580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Volume 8c622df2-ab49-4e1e-9fc7-7a48264cedff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff', 'volume_size': 1} Jul 08 03:36:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:37 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065" returned: 0 in 0.656s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-41871906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41459a3-c3f1-4689-a633-3c636f075624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46376fe44f93440caa32ca04aab940a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:36Z,use_quota=True,user_id='7bd98ae184934956821571cc2ff4c9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Creating volume a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:37 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873d6c36-1aa6-44aa-bc08-d8fe0097755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7ca276-497c-415e-bbc5-c2774f9a7065', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e778fedf-7046-42da-adae-9dce956179f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:37 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 1073741824 Jul 08 03:36:37 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:37 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Volume volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 (ca7ca276-497c-415e-bbc5-c2774f9a7065): created successfully Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e778fedf-7046-42da-adae-9dce956179f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Flow 'volume_create_manager' (996ece38-bfa0-4ec4-84c7-14abd7921c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-afbbfe3c-6941-467b-b2e1-c1edd22d66f4 tempest-VolumesListAdminTestJSON-417620083 None] Created volume successfully. Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Flow 'volume_create_manager' (9f9e22a6-4f27-46f0-b251-82f816af7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649930b2-c4b7-4f8e-95dd-3f80beb0dc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:38 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 1073741824" returned: 0 in 0.869s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649930b2-c4b7-4f8e-95dd-3f80beb0dc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2015958058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a861a6f-24f4-4992-824b-a51108622c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a055c52cd6f4a3eb49a5486eca04ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:38Z,use_quota=True,user_id='090abcf6c70e47b78371c852e1f82003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288ee3e3-19ec-4cc8-91cd-c2108686cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288ee3e3-19ec-4cc8-91cd-c2108686cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b3b260-275b-436a-b47c-04e7edf41e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b3b260-275b-436a-b47c-04e7edf41e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a861a6f-24f4-4992-824b-a51108622c57', 'volume_name': 'volume-2a861a6f-24f4-4992-824b-a51108622c57', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c9aaba-abd6-4be8-9564-a6a4c4dc06d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c9aaba-abd6-4be8-9564-a6a4c4dc06d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d308e04-d689-4dc0-85bf-3e4163e3073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Volume 2a861a6f-24f4-4992-824b-a51108622c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a861a6f-24f4-4992-824b-a51108622c57', 'volume_size': 1} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:38 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 Jul 08 03:36:38 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:38 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624" returned: 0 in 0.640s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1532262347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c622df2-ab49-4e1e-9fc7-7a48264cedff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4aa8c9f8e4bc9bac9c48d538567eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:37Z,use_quota=True,user_id='c7cd3502ec1343d7893fe5ce477df588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Creating volume 8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:38 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff 1073741824 Jul 08 03:36:38 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b963b2aa-8bb7-4fb0-b2fb-184289926a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41459a3-c3f1-4689-a633-3c636f075624', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0e5705-db2c-4695-9a85-9c924bc4a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Volume volume-a41459a3-c3f1-4689-a633-3c636f075624 (a41459a3-c3f1-4689-a633-3c636f075624): created successfully Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0e5705-db2c-4695-9a85-9c924bc4a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Flow 'volume_create_manager' (103f0764-0132-4e84-85a9-b6c8cf26cfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-d5d8c6a9-52c4-4e0e-af12-859c42db6eb3 req-63026574-0a81-4ea3-a9c0-9e0294386164 tempest-VolumesSnapshotsTestJSON-423822055 None] Created volume successfully. Jul 08 03:36:39 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff 1073741824" returned: 0 in 0.804s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:39 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff Jul 08 03:36:39 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:40 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2015958058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a861a6f-24f4-4992-824b-a51108622c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a055c52cd6f4a3eb49a5486eca04ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:38Z,use_quota=True,user_id='090abcf6c70e47b78371c852e1f82003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Creating volume 2a861a6f-24f4-4992-824b-a51108622c57 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:40 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7201de62-d77b-4d5f-97aa-5bb16ddc1580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:40 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 1073741824 Jul 08 03:36:40 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9d9832-460d-4a85-8f04-59dac5758750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Volume volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff (8c622df2-ab49-4e1e-9fc7-7a48264cedff): created successfully Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9d9832-460d-4a85-8f04-59dac5758750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Flow 'volume_create_manager' (1bb60e0f-3d5e-4715-8c7e-8e06c961ab48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5c3df737-57c9-4e24-9d7a-702d4a3afe20 tempest-VolumesDeleteCascade-2045620603 None] Created volume successfully. Jul 08 03:36:41 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 1073741824" returned: 0 in 0.870s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:41 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 Jul 08 03:36:41 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:41 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57" returned: 0 in 0.621s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.704s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d308e04-d689-4dc0-85bf-3e4163e3073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a861a6f-24f4-4992-824b-a51108622c57', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec192b5-aeea-4328-92f4-605419247dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Creating offline snapshot 70815d23-4df9-46e1-9aca-62c4b254bda5 of volume a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:36:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Volume volume-2a861a6f-24f4-4992-824b-a51108622c57 (2a861a6f-24f4-4992-824b-a51108622c57): created successfully Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec192b5-aeea-4328-92f4-605419247dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Flow 'volume_create_manager' (9f9e22a6-4f27-46f0-b251-82f816af7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd0685-c1b0-4ad4-8ee1-3549a594d0e2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:41 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8cb6be73-da0f-43be-abed-1bdace3818be tempest-VolumesListAdminTestJSON-417620083 None] Created volume successfully. Jul 08 03:36:42 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 Jul 08 03:36:42 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:42 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:42 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 1G Jul 08 03:36:42 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Flow 'volume_create_manager' (f3281689-22cb-4d21-b861-5f1eeed3119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61ddcbb-a48a-4b59-b370-00e62a97752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61ddcbb-a48a-4b59-b370-00e62a97752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2059164139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a055c52cd6f4a3eb49a5486eca04ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:43Z,use_quota=True,user_id='090abcf6c70e47b78371c852e1f82003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b061725-18e5-4d4f-8132-45e4d910fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b061725-18e5-4d4f-8132-45e4d910fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d44286-6389-4f14-83a3-f762e86e37c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d44286-6389-4f14-83a3-f762e86e37c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04', 'volume_name': 'volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f751b910-feae-4562-b537-2332d1239de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f751b910-feae-4562-b537-2332d1239de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea25d0a-564b-4a25-9226-0c5bf454b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:42 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Volume ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04', 'volume_size': 1} Jul 08 03:36:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:43 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 1G" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41459a3-c3f1-4689-a633-3c636f075624 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:43 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41459a3-c3f1-4689-a633-3c636f075624 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 Jul 08 03:36:43 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:44 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41459a3-c3f1-4689-a633-3c636f075624 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:44 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 is being set with open permissions: ugo+rw Jul 08 03:36:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:44 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 Jul 08 03:36:44 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:44 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5" returned: 0 in 0.641s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:44 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info Jul 08 03:36:44 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:45 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:45 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info is being set with open permissions: ugo+rw Jul 08 03:36:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:45 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info Jul 08 03:36:45 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:46 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.info" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.301s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.944s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Creating offline snapshot fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f of volume 8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:36:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-09adafd9-566a-4f91-a224-68c82bf84cf1 req-fd532a29-f3a6-4676-93fd-1947156d5d69 tempest-VolumesSnapshotsTestJSON-423822055 None] Create snapshot completed successfully Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a50b1f4-40f3-4e38-b664-ddf3871679c0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:46 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff Jul 08 03:36:46 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "cinder-70815d23-4df9-46e1-9aca-62c4b254bda5-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-70815d23-4df9-46e1-9aca-62c4b254bda5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "cinder-quobyte-a41459a3-c3f1-4689-a633-3c636f075624" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-quobyte-a41459a3-c3f1-4689-a633-3c636f075624" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "cinder-quobyte-70815d23-4df9-46e1-9aca-62c4b254bda5" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:46 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff" returned: 0 in 0.755s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:46 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f 1G Jul 08 03:36:46 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-quobyte-70815d23-4df9-46e1-9aca-62c4b254bda5" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Deleting offline snapshot 70815d23-4df9-46e1-9aca-62c4b254bda5 of volume a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:36:47 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:47 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] snapshot_file for this snap is: volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c8753f-7394-4744-89a7-3bcdd83fe3a2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:47 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 Jul 08 03:36:47 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:47 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.678s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:36:47 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f 1G" returned: 0 in 0.820s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:47 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:36:47 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:47 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5" returned: 0 in 0.769s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a41459a3-c3f1-4689-a633-3c636f075624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea8e812-e69d-4108-afb6-31ddcef6021c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:47 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 Jul 08 03:36:47 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:48 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.698s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:48 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f is being set with open permissions: ugo+rw Jul 08 03:36:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:48 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:36:48 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:48 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624" returned: 0 in 0.789s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:48 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 Jul 08 03:36:48 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:49 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.659s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:49 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info Jul 08 03:36:49 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:49 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5" returned: 0 in 0.726s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:49 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5 Jul 08 03:36:49 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:49 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info" returned: 0 in 0.655s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:49 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info is being set with open permissions: ugo+rw Jul 08 03:36:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:49 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info Jul 08 03:36:49 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:50 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624.70815d23-4df9-46e1-9aca-62c4b254bda5" returned: 0 in 0.653s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-quobyte-70815d23-4df9-46e1-9aca-62c4b254bda5" released by "_delete_snapshot" :: held 3.093s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-quobyte-a41459a3-c3f1-4689-a633-3c636f075624" released by "delete_snapshot" :: held 3.158s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.quota [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Created reservations ['cffef279-3707-450d-a252-e718feb7ddd2', '9e639002-7bc6-45c9-8bd2-e1cd04670611', '5ba26ca5-8cfa-4fba-a85e-51e581881dd7', '1ad8e602-4a2a-4def-926c-781a9a2f5bf6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Delete snapshot completed successfully. Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-5e1e092f-7830-4d66-97a3-be71472a3af5 req-dcbf74cd-ebf4-4dac-9db5-a7533a194c84 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-70815d23-4df9-46e1-9aca-62c4b254bda5-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:50 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.info" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.635s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2059164139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a055c52cd6f4a3eb49a5486eca04ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:43Z,use_quota=True,user_id='090abcf6c70e47b78371c852e1f82003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Creating volume ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:50 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:50 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 1073741824 Jul 08 03:36:50 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-95af3b3c-5fad-4303-83eb-4c07a7e35b37 tempest-VolumesDeleteCascade-2045620603 None] Create snapshot completed successfully Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "cinder-a41459a3-c3f1-4689-a633-3c636f075624-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-a41459a3-c3f1-4689-a633-3c636f075624-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "cinder-quobyte-a41459a3-c3f1-4689-a633-3c636f075624" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-quobyte-a41459a3-c3f1-4689-a633-3c636f075624" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:51 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ef0bf-4f9c-403f-af1a-a2056231de51]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 1073741824" returned: 0 in 0.895s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:51 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 Jul 08 03:36:51 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:51 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 Jul 08 03:36:51 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:52 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04" returned: 0 in 0.661s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.337s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea25d0a-564b-4a25-9226-0c5bf454b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f7a912-415d-4fd6-8797-022fe246159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Creating offline snapshot 3be1b57a-7562-4673-8aff-f4ba31316e4d of volume 8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:36:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Volume volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 (ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04): created successfully Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f7a912-415d-4fd6-8797-022fe246159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Flow 'volume_create_manager' (f3281689-22cb-4d21-b861-5f1eeed3119c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[14661013-6c20-4e25-900e-30ea9a10cea4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:52 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624" returned: 0 in 0.824s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e9700ec2-1aa8-4d0f-8b04-8687a248c262 tempest-VolumesListAdminTestJSON-417620083 None] Created volume successfully. Jul 08 03:36:52 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624 Jul 08 03:36:52 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:52 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:36:52 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:52 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a41459a3-c3f1-4689-a633-3c636f075624" returned: 0 in 0.685s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-quobyte-a41459a3-c3f1-4689-a633-3c636f075624" released by "delete_volume" :: held 1.574s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:52 devstack cinder-volume[86294]: DEBUG cinder.quota [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Created reservations ['bb2b6aba-e1e7-482d-ae74-56985db40e61', 'a5b8d2d3-da05-420e-ac30-c801646d08a0', '3345e2e2-8cc3-4c38-8d15-75e722dc9b7e', '5b2b3a22-ad84-43a8-a167-61c6ffea9f4b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:53 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.826s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:53 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d 1G Jul 08 03:36:53 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:53 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:53 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Flow 'volume_create_manager' (5258d4b1-ee8a-4ee2-8659-d215bfd14b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bcd73a-2e58-4007-99f9-0aac0f21d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bcd73a-2e58-4007-99f9-0aac0f21d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b967c3e-5f43-4eab-b71c-37c2c106ed7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2eb7a22a844a038b33ee87267976c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:53Z,use_quota=True,user_id='46b3db6d0cfd4b2d9d80626b609626c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f79fa6b-6718-4402-95ba-309aec117f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f79fa6b-6718-4402-95ba-309aec117f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d35c07-924b-4c04-ac02-3a3e4e9de231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d35c07-924b-4c04-ac02-3a3e4e9de231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b967c3e-5f43-4eab-b71c-37c2c106ed7b', 'volume_name': 'volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3633d4f-8626-4356-9ae7-d945889a1a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3633d4f-8626-4356-9ae7-d945889a1a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759d9288-a249-41c2-8673-ffd2e4a8f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Volume 3b967c3e-5f43-4eab-b71c-37c2c106ed7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b', 'volume_size': 1} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:53 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.685s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.manager [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:36:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Deleted volume successfully. Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-f2d56590-692a-49cd-ada8-0978a6fc61ed req-c58658e3-9bff-4977-9ae9-12a60f787999 tempest-VolumesSnapshotsTestJSON-423822055 None] Lock "cinder-a41459a3-c3f1-4689-a633-3c636f075624-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:53 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d 1G" returned: 0 in 0.880s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:53 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d Jul 08 03:36:53 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:54 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:54 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d is being set with open permissions: ugo+rw Jul 08 03:36:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:54 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d Jul 08 03:36:54 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:55 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d" returned: 0 in 0.687s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b967c3e-5f43-4eab-b71c-37c2c106ed7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2eb7a22a844a038b33ee87267976c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:53Z,use_quota=True,user_id='46b3db6d0cfd4b2d9d80626b609626c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Creating volume 3b967c3e-5f43-4eab-b71c-37c2c106ed7b {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:55 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:55 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b 1073741824 Jul 08 03:36:55 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ee0ef3de-b6d0-4525-bad5-70fb653553a0 tempest-VolumesDeleteCascade-2045620603 None] Create snapshot completed successfully Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-8c622df2-ab49-4e1e-9fc7-7a48264cedff-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-8c622df2-ab49-4e1e-9fc7-7a48264cedff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Performing cascade delete. {{(pid=86294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-3be1b57a-7562-4673-8aff-f4ba31316e4d-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-3be1b57a-7562-4673-8aff-f4ba31316e4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-3be1b57a-7562-4673-8aff-f4ba31316e4d" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-3be1b57a-7562-4673-8aff-f4ba31316e4d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Deleting offline snapshot 3be1b57a-7562-4673-8aff-f4ba31316e4d of volume 8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] snapshot_file for this snap is: volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf18f5a-1644-4442-a1e7-4237b60d3e51]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:56 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b 1073741824" returned: 0 in 0.997s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:56 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d Jul 08 03:36:56 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:56 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b Jul 08 03:36:56 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:57 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b" returned: 0 in 0.665s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:57 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d" returned: 0 in 0.842s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759d9288-a249-41c2-8673-ffd2e4a8f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2373395c-b0c9-41ea-8634-4761ce0f4e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd23c2ef-a9da-4a8f-8751-42d24ad2b129]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Volume volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b (3b967c3e-5f43-4eab-b71c-37c2c106ed7b): created successfully Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2373395c-b0c9-41ea-8634-4761ce0f4e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Flow 'volume_create_manager' (5258d4b1-ee8a-4ee2-8659-d215bfd14b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f4849f9f-3c38-4885-9434-a217d8052b16 tempest-VolumesListAdminTestJSON-1085194616 None] Created volume successfully. Jul 08 03:36:57 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:36:57 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Flow 'volume_create_manager' (90695956-b37d-4078-8c74-05d6a9ade42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c99932-2887-4d91-b70a-d175fb668a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Acquiring lock "cinder-3b967c3e-5f43-4eab-b71c-37c2c106ed7b-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c99932-2887-4d91-b70a-d175fb668a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-197224882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa18aa80-013e-4579-853d-f44fe40f11bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f928b837146c8993a42ce5f15dda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:57Z,use_quota=True,user_id='9cda47b25c1b40a1a38a97c5a7a26160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec9e4b5-4f44-4aa4-b557-364547970981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec9e4b5-4f44-4aa4-b557-364547970981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0823ee-d945-4210-b291-c763e05bb819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0823ee-d945-4210-b291-c763e05bb819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa18aa80-013e-4579-853d-f44fe40f11bf', 'volume_name': 'volume-aa18aa80-013e-4579-853d-f44fe40f11bf', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04783ed6-8212-48b3-99c8-f5a6d8d5bfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04783ed6-8212-48b3-99c8-f5a6d8d5bfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923b9af8-723b-4cad-b176-feba13f7dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Volume aa18aa80-013e-4579-853d-f44fe40f11bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa18aa80-013e-4579-853d-f44fe40f11bf', 'volume_size': 1} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-197224882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa18aa80-013e-4579-853d-f44fe40f11bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a9f928b837146c8993a42ce5f15dda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:36:57Z,use_quota=True,user_id='9cda47b25c1b40a1a38a97c5a7a26160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Creating volume aa18aa80-013e-4579-853d-f44fe40f11bf {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:36:57 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "cinder-3b967c3e-5f43-4eab-b71c-37c2c106ed7b-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:57 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf 1073741824 Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "cinder-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:57 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Acquiring lock "cinder-quobyte-3b967c3e-5f43-4eab-b71c-37c2c106ed7b" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "cinder-quobyte-3b967c3e-5f43-4eab-b71c-37c2c106ed7b" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "cinder-quobyte-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec1df8-d4ff-4c6b-92ae-7aff5f2971c5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-quobyte-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd021a24-bdc8-4a6e-9769-6b58063f3611]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:57 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b Jul 08 03:36:57 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:57 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 Jul 08 03:36:57 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:58 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.881s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:58 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d Jul 08 03:36:58 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:58 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf 1073741824" returned: 0 in 0.902s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:58 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf Jul 08 03:36:58 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:58 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b" returned: 0 in 0.888s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:58 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b Jul 08 03:36:58 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:58 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04" returned: 0 in 0.857s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:58 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04 Jul 08 03:36:58 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:58 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d" returned: 0 in 0.887s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:58 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d Jul 08 03:36:58 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:59 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf" returned: 0 in 0.673s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923b9af8-723b-4cad-b176-feba13f7dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa18aa80-013e-4579-853d-f44fe40f11bf', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94962935-6c58-4c6a-89b5-65ddc1181273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:36:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Volume volume-aa18aa80-013e-4579-853d-f44fe40f11bf (aa18aa80-013e-4579-853d-f44fe40f11bf): created successfully Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94962935-6c58-4c6a-89b5-65ddc1181273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Flow 'volume_create_manager' (90695956-b37d-4078-8c74-05d6a9ade42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:36:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-83d460f5-eccc-49eb-82ce-0284e5a1c836 req-ba395575-792e-4181-acf2-41b160bfb778 tempest-VolumesGetTestJSON-1036470635 None] Created volume successfully. Jul 08 03:36:59 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3b967c3e-5f43-4eab-b71c-37c2c106ed7b" returned: 0 in 0.716s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "cinder-quobyte-3b967c3e-5f43-4eab-b71c-37c2c106ed7b" released by "delete_volume" :: held 1.665s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:59 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04" returned: 0 in 0.724s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-quobyte-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04" released by "delete_volume" :: held 1.634s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Created reservations ['6029b7a1-91ca-4661-ac6a-98f06cdadadd', '5cadb704-a4eb-415f-bb4b-c77cf1625435', 'daec3056-e74e-4558-8650-1307bf7f9707', 'd74125e7-5f4b-4afd-9148-4f73cfe2a29c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Created reservations ['430cd195-63d0-4148-96c1-6ab912531dd0', '9e96348a-34b9-4593-89b0-616fe8d4ced3', 'af9b53d3-ff8c-4acf-a686-4f54d8954e50', '15160227-ec47-4a97-b462-d5e9848a4534'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:59 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:59 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:36:59 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:36:59 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:36:59 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.3be1b57a-7562-4673-8aff-f4ba31316e4d" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-3be1b57a-7562-4673-8aff-f4ba31316e4d" released by "_delete_snapshot" :: held 3.482s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" released by "delete_snapshot" :: held 3.517s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Created reservations ['6f287f13-0ee8-4c28-a060-079007af03bc', 'f1622766-ac78-4db7-8d6e-b189835f9d77', 'a5fdb486-bb66-4976-92d5-a41e1a0433ce', '3d17b37f-7db4-489f-a767-c381cf43c999'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:36:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Delete snapshot completed successfully. Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-3be1b57a-7562-4673-8aff-f4ba31316e4d-delete_snapshot" released by "delete_snapshot" :: held 3.692s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Deleting offline snapshot fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f of volume 8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] snapshot_file for this snap is: volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Acquiring lock "cinder-aa18aa80-013e-4579-853d-f44fe40f11bf-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334f912-0c4d-4c04-9db7-ff766c7e0161]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:36:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Lock "cinder-aa18aa80-013e-4579-853d-f44fe40f11bf-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "cinder-2a861a6f-24f4-4992-824b-a51108622c57-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-2a861a6f-24f4-4992-824b-a51108622c57-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Acquiring lock "cinder-quobyte-aa18aa80-013e-4579-853d-f44fe40f11bf" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "cinder-quobyte-2a861a6f-24f4-4992-824b-a51108622c57" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Lock "cinder-quobyte-aa18aa80-013e-4579-853d-f44fe40f11bf" acquired by "delete_volume" :: waited 0.047s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:00 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:37:00 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-quobyte-2a861a6f-24f4-4992-824b-a51108622c57" acquired by "delete_volume" :: waited 0.037s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680e399-275e-4e80-b296-e929313f9f7b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b562f86-830a-4316-a329-113c5d9f6766]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:00 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf Jul 08 03:37:00 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:00 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 Jul 08 03:37:00 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:00 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.949s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:00 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Deleted volume successfully. Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6e894789-feda-4017-9b0a-ea48a8248171 tempest-VolumesListAdminTestJSON-1085194616 None] Lock "cinder-3b967c3e-5f43-4eab-b71c-37c2c106ed7b-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:00 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.002s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:00 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Deleted volume successfully. Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8da9da94-e2db-4307-a5bd-4071743944da tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-ab3e3c2e-404f-4ad6-8bb0-e3716b3b2e04-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:00 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.993s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[458faa03-7dac-4387-aeea-abb6c325dd6b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:01 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:01 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf Jul 08 03:37:01 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:01 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff Jul 08 03:37:01 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:01 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57" returned: 0 in 0.914s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:01 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57 Jul 08 03:37:01 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:01 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-aa18aa80-013e-4579-853d-f44fe40f11bf" returned: 0 in 0.706s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:01 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Lock "cinder-quobyte-aa18aa80-013e-4579-853d-f44fe40f11bf" released by "delete_volume" :: held 1.582s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff" returned: 0 in 0.767s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:01 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:37:01 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.quota [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Created reservations ['84b29f4a-5d56-4f92-ad56-e60ef2b90383', 'bb89f7b3-b286-44d0-9586-7f80e196f043', '28f881ba-71ac-4c19-9d1a-36a11cd4fde1', '1b2a9518-b81e-459c-8c3f-3d228133a503'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:01 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a861a6f-24f4-4992-824b-a51108622c57" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-quobyte-2a861a6f-24f4-4992-824b-a51108622c57" released by "delete_volume" :: held 1.645s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Created reservations ['e5e68de1-3e9e-4a38-b359-871cfe372981', '80eb4af6-7013-4040-8c20-d31f9eba6299', 'fd222398-1768-4b16-9092-d79f8cf47e84', '7c359141-07a6-4b23-979c-ba5e8e0efd1f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:01 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:01 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:02 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:02 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "cinder-ca7ca276-497c-415e-bbc5-c2774f9a7065-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-ca7ca276-497c-415e-bbc5-c2774f9a7065-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "cinder-quobyte-ca7ca276-497c-415e-bbc5-c2774f9a7065" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-quobyte-ca7ca276-497c-415e-bbc5-c2774f9a7065" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac43555-9fc5-4799-8399-5ea5b757c330]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:02 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.899s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:02 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.manager [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:02 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f Jul 08 03:37:02 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Deleted volume successfully. Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-88abdca5-274f-4234-9f41-0b28eed1ae1f req-abb61461-6de0-43be-be26-9ccc4966c632 tempest-VolumesGetTestJSON-1036470635 None] Lock "cinder-aa18aa80-013e-4579-853d-f44fe40f11bf-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:02 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 Jul 08 03:37:02 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:02 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.928s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Deleted volume successfully. Jul 08 03:37:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3cdd93a-abd3-4a0d-9840-d48e507db0fa tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-2a861a6f-24f4-4992-824b-a51108622c57-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:03 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff.fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" returned: 0 in 0.709s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f" released by "_delete_snapshot" :: held 3.497s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" released by "delete_snapshot" :: held 3.522s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:03 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Created reservations ['1afa665d-c8ef-44aa-b87f-ef293ab761b9', 'a3eb4aec-4d57-4606-999a-3da2ce55d4fc', '6ed85fcd-b7be-4140-b114-3ab1af700348', '2483a399-ac1c-4c63-a4c2-234e3927b4d6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065" returned: 0 in 0.890s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:03 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065 Jul 08 03:37:03 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:03 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Delete snapshot completed successfully. Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-fbdf7e22-1f5a-46a0-87bc-e217bfb14b6f-delete_snapshot" released by "delete_snapshot" :: held 3.733s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Snapshots deleted, issuing volume delete {{(pid=86294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4871f91-7091-4977-8c8e-3c1fcceef2ae]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:03 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff Jul 08 03:37:03 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:04 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ca7ca276-497c-415e-bbc5-c2774f9a7065" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-quobyte-ca7ca276-497c-415e-bbc5-c2774f9a7065" released by "delete_volume" :: held 1.694s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Created reservations ['7039dc9a-490f-4a7a-979f-5d00f53ff117', 'e201e8e6-f794-4877-98f7-b7994a37fa06', 'e04c59d8-5f97-4d76-978f-b39654d7b561', 'fe9c5adb-6528-4527-a4b0-7d5ff884bd54'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:04 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:04 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:04 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff" returned: 0 in 0.829s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:04 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff Jul 08 03:37:04 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:05 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.702s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:05 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Deleted volume successfully. Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a61c4424-fbad-4626-ad29-bc3a7bdb1010 tempest-VolumesListAdminTestJSON-417620083 None] Lock "cinder-ca7ca276-497c-415e-bbc5-c2774f9a7065-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:05 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8c622df2-ab49-4e1e-9fc7-7a48264cedff" returned: 0 in 0.708s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-8c622df2-ab49-4e1e-9fc7-7a48264cedff" released by "delete_volume" :: held 1.608s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Created reservations ['3444fb03-de66-451e-9a39-34468c2f51eb', 'd214b5d1-041c-4f9f-943e-583ad6f36466', 'a253abdc-72dc-46be-a486-1a9c03b7a1a7', 'c4656a7b-6fb0-46ea-ad59-e4def43d652d'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:05 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:05 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:06 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.751s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Deleted volume successfully. Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2661d624-9cc7-4f90-b345-abddd9ed76ba tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-8c622df2-ab49-4e1e-9fc7-7a48264cedff-delete_volume" released by "delete_volume" :: held 10.093s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Flow 'volume_create_manager' (6b1b163f-78bb-4ac9-8542-a47efa806967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3f39cb-e397-48a1-a3a3-dd6d15680163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3f39cb-e397-48a1-a3a3-dd6d15680163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-665094810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2de64e-d866-42fd-b716-903910d8c3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4aa8c9f8e4bc9bac9c48d538567eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:07Z,use_quota=True,user_id='c7cd3502ec1343d7893fe5ce477df588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d702f74-5b29-4252-8cb5-5b9b188bb1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d702f74-5b29-4252-8cb5-5b9b188bb1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27548f28-d0c1-4c85-9a14-bb59e55daee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27548f28-d0c1-4c85-9a14-bb59e55daee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2de64e-d866-42fd-b716-903910d8c3c3', 'volume_name': 'volume-db2de64e-d866-42fd-b716-903910d8c3c3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02e6fc9-0937-4daf-9351-b416bb0546d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02e6fc9-0937-4daf-9351-b416bb0546d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d44275-efac-4388-8b3e-1c73bcafcd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:06 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Volume db2de64e-d866-42fd-b716-903910d8c3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2de64e-d866-42fd-b716-903910d8c3c3', 'volume_size': 1} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-665094810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2de64e-d866-42fd-b716-903910d8c3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4aa8c9f8e4bc9bac9c48d538567eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:07Z,use_quota=True,user_id='c7cd3502ec1343d7893fe5ce477df588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Creating volume db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:06 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:06 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 1073741824 Jul 08 03:37:06 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:07 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 1073741824" returned: 0 in 0.984s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:07 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=167,cinder:SELECT=123,cinder:INSERT=42,cinder:DELETE=16 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:37:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:07 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:07 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:08 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 0.705s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d44275-efac-4388-8b3e-1c73bcafcd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2de64e-d866-42fd-b716-903910d8c3c3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9db0b01-bb4f-4d8b-83fd-00c08f4e4b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:08 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Volume volume-db2de64e-d866-42fd-b716-903910d8c3c3 (db2de64e-d866-42fd-b716-903910d8c3c3): created successfully Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9db0b01-bb4f-4d8b-83fd-00c08f4e4b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Flow 'volume_create_manager' (6b1b163f-78bb-4ac9-8542-a47efa806967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-20da751f-c1e8-4e9e-af88-aa50b261e7ed tempest-VolumesDeleteCascade-2045620603 None] Created volume successfully. Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Creating offline snapshot 117b3c1d-3e3c-4d12-83bf-7e2f44503de9 of volume db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d18aee-def0-452d-87a6-a096884551b3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:09 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:09 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:09 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:09 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 1G Jul 08 03:37:09 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:10 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 1G" returned: 0 in 0.902s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2de64e-d866-42fd-b716-903910d8c3c3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:10 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2de64e-d866-42fd-b716-903910d8c3c3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 Jul 08 03:37:10 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Flow 'volume_create_manager' (d73e318c-ef5b-4b78-9f30-3b824850d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175890e0-4b73-4913-b6a0-273c34fcc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175890e0-4b73-4913-b6a0-273c34fcc07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-438485015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7b9293-64bb-423f-b8d6-52f003744a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34e87f3bb54b869af8d5c1b2256659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:11Z,use_quota=True,user_id='2100f789e7cc4e9ca63c4fd68de74b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ef0e6d-531d-4071-b0d0-fd2f1bc1bede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ef0e6d-531d-4071-b0d0-fd2f1bc1bede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958d70c5-7adf-48b7-81cb-dfcf9e96d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958d70c5-7adf-48b7-81cb-dfcf9e96d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7b9293-64bb-423f-b8d6-52f003744a2f', 'volume_name': 'volume-3f7b9293-64bb-423f-b8d6-52f003744a2f', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015acf5-59a1-4170-b9ae-991c064fd652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015acf5-59a1-4170-b9ae-991c064fd652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec8cc02-5347-40f4-8b98-e946bffd5f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:11 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Volume 3f7b9293-64bb-423f-b8d6-52f003744a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7b9293-64bb-423f-b8d6-52f003744a2f', 'volume_size': 1} Jul 08 03:37:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:11 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2de64e-d866-42fd-b716-903910d8c3c3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9" returned: 0 in 0.712s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:11 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 is being set with open permissions: ugo+rw Jul 08 03:37:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:11 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 Jul 08 03:37:11 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:12 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9" returned: 0 in 0.644s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:12 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info Jul 08 03:37:12 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:12 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info" returned: 0 in 0.658s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:12 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info is being set with open permissions: ugo+rw Jul 08 03:37:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:12 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info Jul 08 03:37:12 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:13 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.info" returned: 0 in 0.663s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.484s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.423s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-438485015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7b9293-64bb-423f-b8d6-52f003744a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34e87f3bb54b869af8d5c1b2256659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:11Z,use_quota=True,user_id='2100f789e7cc4e9ca63c4fd68de74b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Creating volume 3f7b9293-64bb-423f-b8d6-52f003744a2f {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:13 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:13 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f 1073741824 Jul 08 03:37:13 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-90bb77d1-1f2c-4e43-ba8e-7e4352b8d629 tempest-VolumesDeleteCascade-2045620603 None] Create snapshot completed successfully Jul 08 03:37:14 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f 1073741824" returned: 0 in 0.942s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:14 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f Jul 08 03:37:14 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Flow 'volume_create_manager' (c2cdffe2-9b42-4006-bd7e-84608bc992ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36821db3-2318-4165-9ad3-e7d5dcca67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36821db3-2318-4165-9ad3-e7d5dcca67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292667494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9916b94-7a78-4275-882d-cdb7c5e67119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df4aa8c9f8e4bc9bac9c48d538567eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=117b3c1d-3e3c-4d12-83bf-7e2f44503de9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:15Z,use_quota=True,user_id='c7cd3502ec1343d7893fe5ce477df588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04fbbb8-414a-4fdd-b90d-fab021baf404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04fbbb8-414a-4fdd-b90d-fab021baf404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8ddb1-96c5-421a-bf15-7fa54516f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8ddb1-96c5-421a-bf15-7fa54516f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9916b94-7a78-4275-882d-cdb7c5e67119', 'volume_name': 'volume-e9916b94-7a78-4275-882d-cdb7c5e67119', 'volume_size': 1, 'snapshot_id': '117b3c1d-3e3c-4d12-83bf-7e2f44503de9'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734c190c-434e-41b9-bfc8-9725ebd957ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734c190c-434e-41b9-bfc8-9725ebd957ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19aa3a5-0a14-49b7-8ebd-b841b209c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:14 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Volume e9916b94-7a78-4275-882d-cdb7c5e67119: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9916b94-7a78-4275-882d-cdb7c5e67119', 'volume_size': 1, 'snapshot_id': '117b3c1d-3e3c-4d12-83bf-7e2f44503de9'} Jul 08 03:37:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:15 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f" returned: 0 in 0.720s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.220s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-117b3c1d-3e3c-4d12-83bf-7e2f44503de9-e9916b94-7a78-4275-882d-cdb7c5e67119" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec8cc02-5347-40f4-8b98-e946bffd5f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7b9293-64bb-423f-b8d6-52f003744a2f', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98be3b3-948b-45f1-a1ce-03be17e6a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-117b3c1d-3e3c-4d12-83bf-7e2f44503de9-e9916b94-7a78-4275-882d-cdb7c5e67119" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Creating volume e9916b94-7a78-4275-882d-cdb7c5e67119 from snapshot 117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-e9916b94-7a78-4275-882d-cdb7c5e67119" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Volume volume-3f7b9293-64bb-423f-b8d6-52f003744a2f (3f7b9293-64bb-423f-b8d6-52f003744a2f): created successfully Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98be3b3-948b-45f1-a1ce-03be17e6a763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Flow 'volume_create_manager' (d73e318c-ef5b-4b78-9f30-3b824850d850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-e9916b94-7a78-4275-882d-cdb7c5e67119" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] snapshot: 117b3c1d-3e3c-4d12-83bf-7e2f44503de9, volume: e9916b94-7a78-4275-882d-cdb7c5e67119, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:37:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-15581d08-0b9c-4ab9-bcfc-6e7e3e54d9a2 tempest-VolumesTransfersTest-293102891 None] Created volume successfully. Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1cadef-af82-4d25-90a2-7a574a478f1b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:15 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 Jul 08 03:37:15 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:16 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2de64e-d866-42fd-b716-903910d8c3c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f820bd5-550f-4ddf-8de7-83bfd7ad75f6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:16 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:16 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:16 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 0.848s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:37:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:16 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 Jul 08 03:37:16 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ff760073-262d-4d19-9847-7d5751fff505 tempest-VolumesTransfersTest-1143580965 None] Transfer volume completed successfully. Jul 08 03:37:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Acquiring lock "cinder-3f7b9293-64bb-423f-b8d6-52f003744a2f-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-3f7b9293-64bb-423f-b8d6-52f003744a2f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Acquiring lock "cinder-quobyte-3f7b9293-64bb-423f-b8d6-52f003744a2f" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-quobyte-3f7b9293-64bb-423f-b8d6-52f003744a2f" acquired by "delete_volume" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff34d77c-1dbe-4427-98f4-ef49d570b680]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:19 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f Jul 08 03:37:19 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:20 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f" returned: 0 in 1.690s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:20 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f Jul 08 03:37:20 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:21 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3f7b9293-64bb-423f-b8d6-52f003744a2f" returned: 0 in 1.285s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-quobyte-3f7b9293-64bb-423f-b8d6-52f003744a2f" released by "delete_volume" :: held 3.068s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Created reservations ['cc748921-52c9-42ed-8af9-691791e589de', '2523e826-fd6b-4258-adb2-b88b544f0703', '48af4823-4184-4abd-94ef-247860dd18ad', '399f0f1c-32dd-41e0-b515-e877ef3e6041'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:22 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:22 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:22 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119" returned: 0 in 5.719s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18cf22e-21b3-43d1-a889-576e9a0f018e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:22 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:22 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Flow 'volume_create_manager' (26773aa0-254d-489a-86e2-4ec78057f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba123866-acfa-44b8-bf87-79c2b4ba4e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba123866-acfa-44b8-bf87-79c2b4ba4e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-680546527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd6793f-c9c6-4518-ad62-9e835ee872fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34e87f3bb54b869af8d5c1b2256659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:23Z,use_quota=True,user_id='2100f789e7cc4e9ca63c4fd68de74b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d039b6-3c54-48eb-b0dc-5927ae6d57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d039b6-3c54-48eb-b0dc-5927ae6d57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447d88d5-3c53-4e65-970c-82e488ad4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447d88d5-3c53-4e65-970c-82e488ad4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd6793f-c9c6-4518-ad62-9e835ee872fd', 'volume_name': 'volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:23 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5d2db5-3c69-422b-9824-9891160b2b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5d2db5-3c69-422b-9824-9891160b2b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf6f3eb-4bf8-4e4a-a67d-29e879112748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:23 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Volume ddd6793f-c9c6-4518-ad62-9e835ee872fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd', 'volume_size': 1} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.933s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:23 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Deleted volume successfully. Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bf65c44a-e2fa-46cd-ae04-e1e180024230 tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-3f7b9293-64bb-423f-b8d6-52f003744a2f-delete_volume" released by "delete_volume" :: held 4.428s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:23 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 1.026s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:37:23 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Converted 1024.00 MB image at 179.02 MB/s Jul 08 03:37:23 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 is being set with open permissions: ugo+rw Jul 08 03:37:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:23 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 Jul 08 03:37:23 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:24 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119" returned: 0 in 0.672s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-e9916b94-7a78-4275-882d-cdb7c5e67119" released by "_copy_volume_from_snapshot" :: held 9.161s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-117b3c1d-3e3c-4d12-83bf-7e2f44503de9-e9916b94-7a78-4275-882d-cdb7c5e67119" released by "_create_volume_from_snapshot" :: held 9.208s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.236s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-680546527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd6793f-c9c6-4518-ad62-9e835ee872fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34e87f3bb54b869af8d5c1b2256659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:23Z,use_quota=True,user_id='2100f789e7cc4e9ca63c4fd68de74b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Creating volume ddd6793f-c9c6-4518-ad62-9e835ee872fd {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:24 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:24 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd 1073741824 Jul 08 03:37:24 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19aa3a5-0a14-49b7-8ebd-b841b209c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9916b94-7a78-4275-882d-cdb7c5e67119', 'volume_size': 1, 'snapshot_id': '117b3c1d-3e3c-4d12-83bf-7e2f44503de9'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f3f7e6-9291-4fb7-a188-8dcaf8bf893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:24 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Volume volume-e9916b94-7a78-4275-882d-cdb7c5e67119 (e9916b94-7a78-4275-882d-cdb7c5e67119): created successfully Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f3f7e6-9291-4fb7-a188-8dcaf8bf893d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Flow 'volume_create_manager' (c2cdffe2-9b42-4006-bd7e-84608bc992ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1d2df7d4-1bab-41ef-993c-dfb577acad51 tempest-VolumesDeleteCascade-2045620603 None] Created volume successfully. Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-db2de64e-d866-42fd-b716-903910d8c3c3-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-db2de64e-d866-42fd-b716-903910d8c3c3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Performing cascade delete. {{(pid=86294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-117b3c1d-3e3c-4d12-83bf-7e2f44503de9-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-117b3c1d-3e3c-4d12-83bf-7e2f44503de9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-db2de64e-d866-42fd-b716-903910d8c3c3" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:25 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd 1073741824" returned: 0 in 0.971s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-db2de64e-d866-42fd-b716-903910d8c3c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-117b3c1d-3e3c-4d12-83bf-7e2f44503de9" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-117b3c1d-3e3c-4d12-83bf-7e2f44503de9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Deleting offline snapshot 117b3c1d-3e3c-4d12-83bf-7e2f44503de9 of volume db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] snapshot_file for this snap is: volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb58aee1-eb5e-4012-a09b-1dfbe852eade]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:25 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd Jul 08 03:37:25 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:25 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 Jul 08 03:37:25 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:26 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd" returned: 0 in 0.656s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf6f3eb-4bf8-4e4a-a67d-29e879112748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cacea5b-887f-4b3c-a315-d8bad6c70f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:26 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Volume volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd (ddd6793f-c9c6-4518-ad62-9e835ee872fd): created successfully Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cacea5b-887f-4b3c-a315-d8bad6c70f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Flow 'volume_create_manager' (26773aa0-254d-489a-86e2-4ec78057f833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e8cfb055-1d74-4e81-bb5d-ee93cadf5291 tempest-VolumesTransfersTest-293102891 None] Created volume successfully. Jul 08 03:37:26 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9" returned: 0 in 0.824s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2de64e-d866-42fd-b716-903910d8c3c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fe0f24-54a8-417c-b739-c2ad79f16ff9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:26 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:26 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:27 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 0.767s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:27 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 Jul 08 03:37:27 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Acquiring lock "cinder-ddd6793f-c9c6-4518-ad62-9e835ee872fd-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-ddd6793f-c9c6-4518-ad62-9e835ee872fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Acquiring lock "cinder-quobyte-ddd6793f-c9c6-4518-ad62-9e835ee872fd" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-quobyte-ddd6793f-c9c6-4518-ad62-9e835ee872fd" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dc3e1e-245c-45dc-8c4b-de8ff44fe04a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:27 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9" returned: 0 in 0.850s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:27 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9 Jul 08 03:37:27 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:27 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd Jul 08 03:37:27 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Flow 'volume_create_manager' (2722b776-4f65-4704-868b-373c576fb675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de78beb3-4767-4f16-b859-d5e2995d8ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de78beb3-4767-4f16-b859-d5e2995d8ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1064310989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234930af-5699-4629-adce-5a17e8e278d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca3166767224df5a48bd1be75e34c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:28Z,use_quota=True,user_id='429b5bec95c142fba912cc53ceb0da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba813ab-e642-4462-b2ca-c9474ec14560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba813ab-e642-4462-b2ca-c9474ec14560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b153973-a9b0-45bb-b286-384369fd05aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b153973-a9b0-45bb-b286-384369fd05aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234930af-5699-4629-adce-5a17e8e278d9', 'volume_name': 'volume-234930af-5699-4629-adce-5a17e8e278d9', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2e7a26-3acc-4dc1-8a17-e55e418cfded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2e7a26-3acc-4dc1-8a17-e55e418cfded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7d1028-f952-4d7a-a2ff-5e3aebd7e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:28 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Volume 234930af-5699-4629-adce-5a17e8e278d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234930af-5699-4629-adce-5a17e8e278d9', 'volume_size': 1} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1064310989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234930af-5699-4629-adce-5a17e8e278d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca3166767224df5a48bd1be75e34c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:28Z,use_quota=True,user_id='429b5bec95c142fba912cc53ceb0da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Creating volume 234930af-5699-4629-adce-5a17e8e278d9 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:28 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:28 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 1073741824 Jul 08 03:37:28 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:28 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3.117b3c1d-3e3c-4d12-83bf-7e2f44503de9" returned: 0 in 0.673s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:28 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-117b3c1d-3e3c-4d12-83bf-7e2f44503de9" released by "_delete_snapshot" :: held 3.237s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-db2de64e-d866-42fd-b716-903910d8c3c3" released by "delete_snapshot" :: held 3.270s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:28 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd Jul 08 03:37:28 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Created reservations ['8abeb42e-ec9f-41e1-ac4d-0a6c09c994ef', '1dc14463-f5c8-43a3-b12b-a19e9b255c05', '902c7ac5-6a69-4e71-9e63-167d1369079e', '6f354dd8-e449-4bea-8713-e94ab7428fbe'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Delete snapshot completed successfully. Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-117b3c1d-3e3c-4d12-83bf-7e2f44503de9-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Snapshots deleted, issuing volume delete {{(pid=86294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-db2de64e-d866-42fd-b716-903910d8c3c3" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-db2de64e-d866-42fd-b716-903910d8c3c3" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fd140d-1caa-4b75-8a72-224c2a2392cb]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:28 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 1073741824" returned: 0 in 0.898s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:28 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:28 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:28 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 Jul 08 03:37:28 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:29 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ddd6793f-c9c6-4518-ad62-9e835ee872fd" returned: 0 in 0.687s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-quobyte-ddd6793f-c9c6-4518-ad62-9e835ee872fd" released by "delete_volume" :: held 1.529s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Created reservations ['26c562d9-c235-4fbb-a976-a2c4b6091645', 'df63a195-5ad4-4e6d-a8c0-b2390845dbcf', '75ff685f-57e9-43f6-9b9a-9359262de25d', '98a0b710-58a0-4e64-b522-e7f577418243'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:29 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:29 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:29 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:29 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9" returned: 0 in 0.678s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:29 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3 Jul 08 03:37:29 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7d1028-f952-4d7a-a2ff-5e3aebd7e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234930af-5699-4629-adce-5a17e8e278d9', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72284bcf-df9e-4916-9ead-a60fd9f048e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:29 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Volume volume-234930af-5699-4629-adce-5a17e8e278d9 (234930af-5699-4629-adce-5a17e8e278d9): created successfully Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72284bcf-df9e-4916-9ead-a60fd9f048e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Flow 'volume_create_manager' (2722b776-4f65-4704-868b-373c576fb675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-cfbf0ebb-2e42-4abe-81f8-7467ba9044a3 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Created volume successfully. Jul 08 03:37:30 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.691s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Deleted volume successfully. Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-32ede36b-3a32-4527-8340-4ee76712f97b tempest-VolumesTransfersTest-1551899288 None] Lock "cinder-ddd6793f-c9c6-4518-ad62-9e835ee872fd-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:30 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-db2de64e-d866-42fd-b716-903910d8c3c3" returned: 0 in 0.667s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-db2de64e-d866-42fd-b716-903910d8c3c3" released by "delete_volume" :: held 1.514s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Created reservations ['6483c85e-cf48-454a-955d-0eb76083b096', 'f8a69c95-b210-4753-9f4c-367ddaf9054c', 'c5107735-c5f4-4b79-8115-02105e38360b', '3fa9f5e3-b45b-4617-9242-480cb674516b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:30 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:30 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-e9916b94-7a78-4275-882d-cdb7c5e67119-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-e9916b94-7a78-4275-882d-cdb7c5e67119-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "cinder-quobyte-e9916b94-7a78-4275-882d-cdb7c5e67119" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-e9916b94-7a78-4275-882d-cdb7c5e67119" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[42748296-dc69-46fe-b69e-bf81a0977604]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Acquiring lock "cinder-234930af-5699-4629-adce-5a17e8e278d9-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:31 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 Jul 08 03:37:31 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "cinder-234930af-5699-4629-adce-5a17e8e278d9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Acquiring lock "cinder-quobyte-234930af-5699-4629-adce-5a17e8e278d9" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "cinder-quobyte-234930af-5699-4629-adce-5a17e8e278d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dab753-4507-4837-bb36-c2e83663aed0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:31 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.895s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Deleted volume successfully. Jul 08 03:37:31 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 Jul 08 03:37:31 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-df596eff-34fc-45a0-8e00-4bc6753d828e tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-db2de64e-d866-42fd-b716-903910d8c3c3-delete_volume" released by "delete_volume" :: held 6.104s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:31 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119" returned: 0 in 0.818s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:31 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119 Jul 08 03:37:31 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:32 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9" returned: 0 in 0.887s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:32 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9 Jul 08 03:37:32 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:32 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e9916b94-7a78-4275-882d-cdb7c5e67119" returned: 0 in 0.731s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-quobyte-e9916b94-7a78-4275-882d-cdb7c5e67119" released by "delete_volume" :: held 1.600s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Created reservations ['85dca729-b757-47b7-bcb5-9e79c5dc9166', '32fd2dea-1af7-4317-a315-52ed13262a8d', 'a2c764bd-b82c-44e4-8d8d-73e88a01cf48', 'b6c0f4ef-d8ef-4746-8e19-3fe8c4a465d3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:32 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:32 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:32 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-234930af-5699-4629-adce-5a17e8e278d9" returned: 0 in 0.737s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "cinder-quobyte-234930af-5699-4629-adce-5a17e8e278d9" released by "delete_volume" :: held 1.685s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:32 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Created reservations ['0dadf463-430b-49d8-bc5f-d0f30ef2b32d', '65b7299e-f1e9-411d-9cf0-12a46ea6b3f5', 'ac727571-9209-4e3f-860c-6316b10a1da7', '75b4b074-2ddc-48ca-bcc4-6135d7bdf1b7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:33 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:33 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:33 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.862s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Deleted volume successfully. Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9b53cd9b-1ea6-451f-8842-337b691171f2 tempest-VolumesDeleteCascade-2045620603 None] Lock "cinder-e9916b94-7a78-4275-882d-cdb7c5e67119-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:33 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.807s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Deleted volume successfully. Jul 08 03:37:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-185d393e-2bce-412b-b03e-761d5ff58a74 tempest-VolumeQuotasNegativeTestJSON-785553957 None] Lock "cinder-234930af-5699-4629-adce-5a17e8e278d9-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=165,cinder:SELECT=109,cinder:DELETE=13,cinder:INSERT=42 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Flow 'volume_create_manager' (57324211-5804-40e7-adec-18c99d139791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e091b09-6cdb-4838-9074-8005d50942ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e091b09-6cdb-4838-9074-8005d50942ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1607411057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb17914-e3b1-4625-b76c-28ddd55b8b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d23900f88a46979908d6afcaadcbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:37Z,use_quota=True,user_id='55df3b1ef22649feabcea702571d99fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cab379-adc9-4173-985c-34aa9c6052b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cab379-adc9-4173-985c-34aa9c6052b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d2b541-c97a-42cf-bb03-1cc0913ff296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d2b541-c97a-42cf-bb03-1cc0913ff296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb17914-e3b1-4625-b76c-28ddd55b8b78', 'volume_name': 'volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1abd3b-970a-43ef-aa58-7c72a8695a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1abd3b-970a-43ef-aa58-7c72a8695a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133fd002-4f22-40da-9ae8-d1485703996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:37 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Volume 2fb17914-e3b1-4625-b76c-28ddd55b8b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78', 'volume_size': 1} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1607411057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb17914-e3b1-4625-b76c-28ddd55b8b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d23900f88a46979908d6afcaadcbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:37Z,use_quota=True,user_id='55df3b1ef22649feabcea702571d99fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Creating volume 2fb17914-e3b1-4625-b76c-28ddd55b8b78 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:37 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:37 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 1073741824 Jul 08 03:37:37 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:38 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 1073741824" returned: 0 in 0.997s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Flow 'volume_create_manager' (e88cd07e-ed22-46a5-a7c5-06ff3235c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab1a605-8b24-42b7-a42d-66caeb007a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab1a605-8b24-42b7-a42d-66caeb007a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-380814831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6632a81e-56e0-4e45-9d67-5f7930895405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ec019388646e59c67b7ec6c40f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:38Z,use_quota=True,user_id='bdbf04e9aa524a259a94bb8af944790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038464a3-5236-4588-a9e2-acf874eddf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:38 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 Jul 08 03:37:38 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038464a3-5236-4588-a9e2-acf874eddf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b22c46-8cd7-4740-9a75-2d8617250b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b22c46-8cd7-4740-9a75-2d8617250b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6632a81e-56e0-4e45-9d67-5f7930895405', 'volume_name': 'volume-6632a81e-56e0-4e45-9d67-5f7930895405', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d4bf45-5ffc-4cbd-ac17-983bc94d2edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d4bf45-5ffc-4cbd-ac17-983bc94d2edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a242f8e9-d8ce-495f-a51d-d032f9a10f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Volume 6632a81e-56e0-4e45-9d67-5f7930895405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6632a81e-56e0-4e45-9d67-5f7930895405', 'volume_size': 1} Jul 08 03:37:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:39 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-380814831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6632a81e-56e0-4e45-9d67-5f7930895405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ec019388646e59c67b7ec6c40f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:38Z,use_quota=True,user_id='bdbf04e9aa524a259a94bb8af944790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Creating volume 6632a81e-56e0-4e45-9d67-5f7930895405 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:39 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133fd002-4f22-40da-9ae8-d1485703996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:39 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 1073741824 Jul 08 03:37:39 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195af3b8-ff06-4593-a9b9-2178bda3647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Volume volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 (2fb17914-e3b1-4625-b76c-28ddd55b8b78): created successfully Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195af3b8-ff06-4593-a9b9-2178bda3647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Flow 'volume_create_manager' (57324211-5804-40e7-adec-18c99d139791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-03ea5f87-555f-4cf5-8789-d3966afb756e tempest-VolumesMetadataTest-1688910155 None] Created volume successfully. Jul 08 03:37:40 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 1073741824" returned: 0 in 0.914s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Acquiring lock "cinder-2fb17914-e3b1-4625-b76c-28ddd55b8b78-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:40 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 Jul 08 03:37:40 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Lock "cinder-2fb17914-e3b1-4625-b76c-28ddd55b8b78-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Acquiring lock "cinder-quobyte-2fb17914-e3b1-4625-b76c-28ddd55b8b78" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Lock "cinder-quobyte-2fb17914-e3b1-4625-b76c-28ddd55b8b78" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3a74c-0ed8-44a7-b080-c193055cf1ea]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:40 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 Jul 08 03:37:40 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:40 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405" returned: 0 in 0.738s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a242f8e9-d8ce-495f-a51d-d032f9a10f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6632a81e-56e0-4e45-9d67-5f7930895405', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da956ab1-31f6-49bc-8c77-a29f070cf93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Volume volume-6632a81e-56e0-4e45-9d67-5f7930895405 (6632a81e-56e0-4e45-9d67-5f7930895405): created successfully Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da956ab1-31f6-49bc-8c77-a29f070cf93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Flow 'volume_create_manager' (e88cd07e-ed22-46a5-a7c5-06ff3235c838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a2355577-c8b4-4a2f-adeb-8d6d509d9663 tempest-VolumesTransfersV355Test-618335275 None] Created volume successfully. Jul 08 03:37:41 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78" returned: 0 in 0.786s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:41 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78 Jul 08 03:37:41 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:41 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2fb17914-e3b1-4625-b76c-28ddd55b8b78" returned: 0 in 0.694s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Lock "cinder-quobyte-2fb17914-e3b1-4625-b76c-28ddd55b8b78" released by "delete_volume" :: held 1.536s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Created reservations ['f3bac692-daca-4beb-a111-55c68f7d0b32', '2b7f40f4-bacb-4119-b025-c38a01d80e55', 'bda64856-a81e-4de0-8a2e-db5c586be642', 'e5a6e431-18f6-4f3e-b74b-2400fa429d7f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:41 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:41 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c4337974-c490-43d1-8bda-131a1daa8e46 tempest-VolumesTransfersV355Test-1378279127 None] Transfer volume completed successfully. Jul 08 03:37:42 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.780s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Deleted volume successfully. Jul 08 03:37:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48a8dbbd-5145-4d58-9b4b-c37dd1125155 tempest-VolumesMetadataTest-1688910155 None] Lock "cinder-2fb17914-e3b1-4625-b76c-28ddd55b8b78-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Acquiring lock "cinder-6632a81e-56e0-4e45-9d67-5f7930895405-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-6632a81e-56e0-4e45-9d67-5f7930895405-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Acquiring lock "cinder-quobyte-6632a81e-56e0-4e45-9d67-5f7930895405" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-quobyte-6632a81e-56e0-4e45-9d67-5f7930895405" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b4241-c706-4fc8-82e9-1387c6c0f6b8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:43 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 Jul 08 03:37:43 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:44 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405" returned: 0 in 0.798s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:44 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405 Jul 08 03:37:44 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:45 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6632a81e-56e0-4e45-9d67-5f7930895405" returned: 0 in 0.749s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-quobyte-6632a81e-56e0-4e45-9d67-5f7930895405" released by "delete_volume" :: held 1.593s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Created reservations ['1d6aa7de-b888-4c7d-8438-90b465cefc9f', '9c4b6cc9-d9b2-4c09-8a4d-7a17651d4535', '361ec249-c92f-488d-8b0d-06ddd63a0d36', '9445fd30-6b8c-45b0-9d48-86293e469356'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (26141f97-2fb9-430d-83bf-00af3d4bd056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0822683a-6524-4096-9e5d-13657cd9efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0822683a-6524-4096-9e5d-13657cd9efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1226877941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d89d12-ae5a-460f-b30d-5d56030bd9d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:45Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3a38a6-204f-45f5-a608-5ac4f87fec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3a38a6-204f-45f5-a608-5ac4f87fec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ac80f5-28d0-45f2-aa8c-284e8100cb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ac80f5-28d0-45f2-aa8c-284e8100cb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d89d12-ae5a-460f-b30d-5d56030bd9d0', 'volume_name': 'volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6298547-b295-4728-a144-ca04989205d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6298547-b295-4728-a144-ca04989205d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60adeb3-5f34-418b-9ae4-86b708dd46c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:45 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Volume f6d89d12-ae5a-460f-b30d-5d56030bd9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0', 'volume_size': 1} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1226877941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d89d12-ae5a-460f-b30d-5d56030bd9d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:45Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Creating volume f6d89d12-ae5a-460f-b30d-5d56030bd9d0 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:45 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:45 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 1073741824 Jul 08 03:37:45 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:45 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:45 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:46 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Deleted volume successfully. Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90107589-2e14-4f63-a2ac-3c1532b4e505 tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-6632a81e-56e0-4e45-9d67-5f7930895405-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:46 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 1073741824" returned: 0 in 0.959s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:46 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 Jul 08 03:37:46 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Flow 'volume_create_manager' (f0460291-d4f3-4918-b3f7-faeec2aa3be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e922ce-caa8-4783-ac21-44b8e3332f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e922ce-caa8-4783-ac21-44b8e3332f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-370028440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38888f19-82f2-4e53-8911-c13b99dc758b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ec019388646e59c67b7ec6c40f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:46Z,use_quota=True,user_id='bdbf04e9aa524a259a94bb8af944790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebe666a-90d9-4cf8-8189-63f8b03d52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebe666a-90d9-4cf8-8189-63f8b03d52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36748c13-555f-4e7f-a539-7e4ccb5effca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36748c13-555f-4e7f-a539-7e4ccb5effca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38888f19-82f2-4e53-8911-c13b99dc758b', 'volume_name': 'volume-38888f19-82f2-4e53-8911-c13b99dc758b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f85c0-a3e5-4282-baf1-284895864bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f85c0-a3e5-4282-baf1-284895864bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f62e4c-2ecf-4662-88a4-b32a84142ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Volume 38888f19-82f2-4e53-8911-c13b99dc758b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38888f19-82f2-4e53-8911-c13b99dc758b', 'volume_size': 1} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Flow 'volume_create_manager' (74b14357-8595-4485-8e8d-0ed8209e7b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba9ad55-b732-42f0-ae17-eb681865be1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba9ad55-b732-42f0-ae17-eb681865be1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1408287828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89307b3-8e31-4be0-96be-7ed9e0efb219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365480a382c6444f9bf5e42e8930034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:47Z,use_quota=True,user_id='df67d3e796284669af3260af27c57f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe01593-ff8a-4f7f-b956-9c7ae9e442c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe01593-ff8a-4f7f-b956-9c7ae9e442c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284025d7-0053-4838-95b8-99890646e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284025d7-0053-4838-95b8-99890646e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89307b3-8e31-4be0-96be-7ed9e0efb219', 'volume_name': 'volume-e89307b3-8e31-4be0-96be-7ed9e0efb219', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2298f6ca-9010-413e-9faa-90dd3191135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2298f6ca-9010-413e-9faa-90dd3191135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c235e377-6d08-4265-8b72-0195748a955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:46 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Volume e89307b3-8e31-4be0-96be-7ed9e0efb219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89307b3-8e31-4be0-96be-7ed9e0efb219', 'volume_size': 1} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:47 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:47 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:47 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0" returned: 0 in 0.668s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-370028440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38888f19-82f2-4e53-8911-c13b99dc758b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ec019388646e59c67b7ec6c40f452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:46Z,use_quota=True,user_id='bdbf04e9aa524a259a94bb8af944790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Creating volume 38888f19-82f2-4e53-8911-c13b99dc758b {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:47 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:47 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b 1073741824 Jul 08 03:37:47 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60adeb3-5f34-418b-9ae4-86b708dd46c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e752e344-8ad1-47bb-8b38-7db26183d069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:47 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Volume volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 (f6d89d12-ae5a-460f-b30d-5d56030bd9d0): created successfully Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e752e344-8ad1-47bb-8b38-7db26183d069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (26141f97-2fb9-430d-83bf-00af3d4bd056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5b6dc6a2-7eb3-4d44-84c3-e9303b37668e tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:37:47 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.695s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:37:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:37:48 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b 1073741824" returned: 0 in 0.866s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:48 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b Jul 08 03:37:48 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (c0f27388-ac48-4e62-9127-e9ad650c7dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fca2655-df99-4903-b0d8-8e76c43c105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fca2655-df99-4903-b0d8-8e76c43c105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1123104917',display_name='tempest-VolumesGetTest-Volume-355269780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0543ef74-4340-4e5c-af3b-b2213ead8190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:48Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b2ddd5-b8be-4c6e-820a-dbfc705d88d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b2ddd5-b8be-4c6e-820a-dbfc705d88d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba26ebc-d4ec-4115-87c1-04a857de913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba26ebc-d4ec-4115-87c1-04a857de913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0543ef74-4340-4e5c-af3b-b2213ead8190', 'volume_name': 'volume-0543ef74-4340-4e5c-af3b-b2213ead8190', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959927e-2ef4-4b30-860b-86d8276bfbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959927e-2ef4-4b30-860b-86d8276bfbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc310df-4120-41b8-832f-7e3da18a7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Volume 0543ef74-4340-4e5c-af3b-b2213ead8190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0543ef74-4340-4e5c-af3b-b2213ead8190', 'volume_size': 1} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:48 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1408287828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89307b3-8e31-4be0-96be-7ed9e0efb219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365480a382c6444f9bf5e42e8930034b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:47Z,use_quota=True,user_id='df67d3e796284669af3260af27c57f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Creating volume e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:48 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:48 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 1073741824 Jul 08 03:37:48 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f62e4c-2ecf-4662-88a4-b32a84142ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38888f19-82f2-4e53-8911-c13b99dc758b', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a269c4-88c6-4282-967c-9d5866210c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Volume volume-38888f19-82f2-4e53-8911-c13b99dc758b (38888f19-82f2-4e53-8911-c13b99dc758b): created successfully Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a269c4-88c6-4282-967c-9d5866210c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Flow 'volume_create_manager' (f0460291-d4f3-4918-b3f7-faeec2aa3be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-47af9d57-35c3-4666-85a5-8269b4d4c025 tempest-VolumesTransfersV355Test-618335275 None] Created volume successfully. Jul 08 03:37:49 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 1073741824" returned: 0 in 0.797s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:49 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 Jul 08 03:37:49 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Acquiring lock "cinder-38888f19-82f2-4e53-8911-c13b99dc758b-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-38888f19-82f2-4e53-8911-c13b99dc758b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Acquiring lock "cinder-quobyte-38888f19-82f2-4e53-8911-c13b99dc758b" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-quobyte-38888f19-82f2-4e53-8911-c13b99dc758b" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[154de2cd-73a9-43d9-88eb-7ea3bbffab69]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:50 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b Jul 08 03:37:50 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:50 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1123104917',display_name='tempest-VolumesGetTest-Volume-355269780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0543ef74-4340-4e5c-af3b-b2213ead8190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:48Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Creating volume 0543ef74-4340-4e5c-af3b-b2213ead8190 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:50 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c235e377-6d08-4265-8b72-0195748a955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89307b3-8e31-4be0-96be-7ed9e0efb219', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:50 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 1073741824 Jul 08 03:37:50 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7a9e03-146a-429b-a92f-32d78d43e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:50 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Volume volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 (e89307b3-8e31-4be0-96be-7ed9e0efb219): created successfully Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7a9e03-146a-429b-a92f-32d78d43e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Flow 'volume_create_manager' (74b14357-8595-4485-8e8d-0ed8209e7b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b8f1ace8-1e80-4bef-a495-fe5f3640796e tempest-SnapshotMetadataTestJSON-1941159623 None] Created volume successfully. Jul 08 03:37:50 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b" returned: 0 in 0.760s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:50 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b Jul 08 03:37:50 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:51 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 1073741824" returned: 0 in 0.818s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:51 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 Jul 08 03:37:51 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:51 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-38888f19-82f2-4e53-8911-c13b99dc758b" returned: 0 in 0.743s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-quobyte-38888f19-82f2-4e53-8911-c13b99dc758b" released by "delete_volume" :: held 1.544s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Created reservations ['7ef8210d-b77b-4460-b148-2b281e0ca7f8', '8774df52-c387-433e-9bbd-098c5e759e9d', '14f17ba4-83a0-4c4c-bb3b-15c731e950df', '7471459c-1042-4bf0-8fa9-852f3c99ffb5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:51 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:51 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:51 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190" returned: 0 in 0.709s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.474s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc310df-4120-41b8-832f-7e3da18a7214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0543ef74-4340-4e5c-af3b-b2213ead8190', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f3bf3b-b8ce-4e75-b566-e7229946a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Creating offline snapshot 1daa8b01-3f6f-42c2-aa18-18230ae6b81c of volume e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:37:51 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Volume volume-0543ef74-4340-4e5c-af3b-b2213ead8190 (0543ef74-4340-4e5c-af3b-b2213ead8190): created successfully Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f3bf3b-b8ce-4e75-b566-e7229946a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (c0f27388-ac48-4e62-9127-e9ad650c7dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[06611e71-ed04-4673-b67d-c10c777d8e9b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5dba39b4-a8ee-499d-946f-f4be59e5a98e tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:37:51 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 Jul 08 03:37:51 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:52 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.655s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Deleted volume successfully. Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e9437efa-df76-48d1-80e0-b0d034c533bc tempest-VolumesTransfersV355Test-28844807 None] Lock "cinder-38888f19-82f2-4e53-8911-c13b99dc758b-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-0543ef74-4340-4e5c-af3b-b2213ead8190-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Lock "cinder-0543ef74-4340-4e5c-af3b-b2213ead8190-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-0543ef74-4340-4e5c-af3b-b2213ead8190" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-0543ef74-4340-4e5c-af3b-b2213ead8190" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05244c-6c10-4d69-b899-49eb04416234]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:52 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219" returned: 0 in 0.925s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:52 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 Jul 08 03:37:52 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:52 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c 1G Jul 08 03:37:52 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:53 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190" returned: 0 in 0.843s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:53 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190 Jul 08 03:37:53 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:53 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c 1G" returned: 0 in 0.930s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:53 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c Jul 08 03:37:53 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:54 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0543ef74-4340-4e5c-af3b-b2213ead8190" returned: 0 in 0.671s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-0543ef74-4340-4e5c-af3b-b2213ead8190" released by "delete_volume" :: held 1.569s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Created reservations ['3440895a-7082-4cd8-be0c-1cf2ef480749', '860d80c4-70df-4f1a-94ec-40edbc248378', '90b34cdb-fd19-4079-b1ae-ee4f9084176f', '9f12f12b-1774-43c3-822b-e7e4e494b176'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:54 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:54 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:54 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c" returned: 0 in 0.847s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:54 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c is being set with open permissions: ugo+rw Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:54 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c Jul 08 03:37:54 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-f6d89d12-ae5a-460f-b30d-5d56030bd9d0-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Lock "cinder-f6d89d12-ae5a-460f-b30d-5d56030bd9d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-f6d89d12-ae5a-460f-b30d-5d56030bd9d0" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-f6d89d12-ae5a-460f-b30d-5d56030bd9d0" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b8d5e-ca21-40ad-9407-5b16c2a44f32]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:55 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 Jul 08 03:37:55 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:55 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.882s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8a3b6317-b93c-4731-85fb-d974710e8d62 tempest-VolumesGetTest-2052705606 None] Lock "cinder-0543ef74-4340-4e5c-af3b-b2213ead8190-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:55 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:55 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info Jul 08 03:37:55 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:55 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0" returned: 0 in 0.881s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:56 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0 Jul 08 03:37:56 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:56 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:56 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info is being set with open permissions: ugo+rw Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:56 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info Jul 08 03:37:56 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:56 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f6d89d12-ae5a-460f-b30d-5d56030bd9d0" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-f6d89d12-ae5a-460f-b30d-5d56030bd9d0" released by "delete_volume" :: held 1.673s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Created reservations ['d5e05d91-f15a-4277-9aaa-c0f1ca1d8214', 'c89fe639-d2c2-48e5-8be7-80477b8b368e', '090eb719-83a4-4358-a720-5e653c9ac15b', '8ec1dabc-f2f3-4a59-99cb-caac4f3d46ec'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:37:56 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.info" returned: 0 in 0.668s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ef9b5c32-2f62-44e2-92be-f38da8d19a81 tempest-SnapshotMetadataTestJSON-1941159623 None] Create snapshot completed successfully Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:56 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:37:56 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:57 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.711s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:37:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b91fe4d7-0054-4798-a9af-10bf5c5e2221 tempest-VolumesGetTest-2052705606 None] Lock "cinder-f6d89d12-ae5a-460f-b30d-5d56030bd9d0-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (eac4e0c9-5850-4d54-bfb8-06ad0333de2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e8eba-b679-43b0-bbc7-827cae03ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e8eba-b679-43b0-bbc7-827cae03ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1782211444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:58Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63b35d2-fcba-43d5-8710-052e6e293c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63b35d2-fcba-43d5-8710-052e6e293c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b9c6f9-ec30-4881-9cd0-f3f7574c5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b9c6f9-ec30-4881-9cd0-f3f7574c5640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'volume_name': 'volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64da460d-1238-4573-8b51-2aef3b133b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64da460d-1238-4573-8b51-2aef3b133b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a28968-5152-4060-90ba-1a705945346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Volume ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'volume_size': 1} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1782211444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:58Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Creating volume ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:57 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:57 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd 1073741824 Jul 08 03:37:57 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Flow 'volume_create_manager' (cc5f21e4-08c1-436f-8845-907059b5ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088701d2-42fa-4f33-b74a-df01a0c0ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088701d2-42fa-4f33-b74a-df01a0c0ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1948722480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6073d0f-5b48-4855-9b32-ac390a85718e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e945b9076649f691bae89325649bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:58Z,use_quota=True,user_id='c717180f583048879293de8b6fef3a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e769b164-4764-4550-bcf7-145950263a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e769b164-4764-4550-bcf7-145950263a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a1c4de-e649-45b1-993a-47e88c542f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a1c4de-e649-45b1-993a-47e88c542f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6073d0f-5b48-4855-9b32-ac390a85718e', 'volume_name': 'volume-a6073d0f-5b48-4855-9b32-ac390a85718e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f2c59e-6fe4-425a-8da2-c7f649fbba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f2c59e-6fe4-425a-8da2-c7f649fbba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1da1232-6d98-4dea-b91a-b4adc316ce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:58 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Volume a6073d0f-5b48-4855-9b32-ac390a85718e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6073d0f-5b48-4855-9b32-ac390a85718e', 'volume_size': 1} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "cinder-1daa8b01-3f6f-42c2-aa18-18230ae6b81c-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-1daa8b01-3f6f-42c2-aa18-18230ae6b81c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "cinder-quobyte-e89307b3-8e31-4be0-96be-7ed9e0efb219" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-quobyte-e89307b3-8e31-4be0-96be-7ed9e0efb219" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "cinder-quobyte-1daa8b01-3f6f-42c2-aa18-18230ae6b81c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-quobyte-1daa8b01-3f6f-42c2-aa18-18230ae6b81c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Deleting offline snapshot 1daa8b01-3f6f-42c2-aa18-18230ae6b81c of volume e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] snapshot_file for this snap is: volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c4cdeb-eef0-4cb6-b125-95c5c83a84a4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:58 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c Jul 08 03:37:58 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:58 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd 1073741824" returned: 0 in 0.866s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:58 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:37:58 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:59 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c" returned: 0 in 0.801s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89307b3-8e31-4be0-96be-7ed9e0efb219(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45df96-c307-40a0-b664-99136fef9e07]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:59 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 Jul 08 03:37:59 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:59 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.667s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1948722480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6073d0f-5b48-4855-9b32-ac390a85718e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e945b9076649f691bae89325649bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:37:58Z,use_quota=True,user_id='c717180f583048879293de8b6fef3a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Creating volume a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:37:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a28968-5152-4060-90ba-1a705945346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d190c96-75a1-4620-9716-dd022085b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:37:59 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e 1073741824 Jul 08 03:37:59 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:37:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Volume volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd (ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd): created successfully Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d190c96-75a1-4620-9716-dd022085b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:37:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (eac4e0c9-5850-4d54-bfb8-06ad0333de2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:37:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c1dd3470-e8b0-4a1e-b057-84f8f3f61572 tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:38:00 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219" returned: 0 in 0.778s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:00 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c Jul 08 03:38:00 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (ef09ae11-0152-4570-ba02-7a9cd987af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ce1fcf-41c9-49d1-b412-7b70f98faefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ce1fcf-41c9-49d1-b412-7b70f98faefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2017922282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161cb0d5-f442-4d98-9125-e508a78733ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:00Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caac8310-add6-4789-8cb5-0a3c59c1a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caac8310-add6-4789-8cb5-0a3c59c1a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86241a1a-a2ae-4581-9537-ec7aaacd7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:00 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e 1073741824" returned: 0 in 0.950s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86241a1a-a2ae-4581-9537-ec7aaacd7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '161cb0d5-f442-4d98-9125-e508a78733ec', 'volume_name': 'volume-161cb0d5-f442-4d98-9125-e508a78733ec', 'volume_size': 1, 'source_volid': 'ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'source_volstatus': 'available'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6ff012-73d7-415e-b3d4-e6d5ba344345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6ff012-73d7-415e-b3d4-e6d5ba344345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e80ca5-4d0f-4072-81b8-e6fa57fc70d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:00 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Volume 161cb0d5-f442-4d98-9125-e508a78733ec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-161cb0d5-f442-4d98-9125-e508a78733ec', 'volume_size': 1, 'source_volid': 'ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'source_volstatus': 'available'} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:00 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:00 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:00 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c" returned: 0 in 0.750s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:00 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c Jul 08 03:38:00 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:01 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.678s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:01 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Cloning volume ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd to volume 161cb0d5-f442-4d98-9125-e508a78733ec Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1da1232-6d98-4dea-b91a-b4adc316ce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6073d0f-5b48-4855-9b32-ac390a85718e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e646ed-6440-4753-82ea-55f82ec21f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Volume volume-a6073d0f-5b48-4855-9b32-ac390a85718e (a6073d0f-5b48-4855-9b32-ac390a85718e): created successfully Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e646ed-6440-4753-82ea-55f82ec21f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Flow 'volume_create_manager' (cc5f21e4-08c1-436f-8845-907059b5ab22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Creating offline snapshot 9a461797-c8e2-4b42-b04e-4b553d143761 of volume ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:38:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-502996c3-1b79-43e3-9cf4-5b9f6bbac81a tempest-VolumesCloneTest-1752140044 None] Created volume successfully. Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2bcea5-7862-4da6-9649-8f2d2c9ee19c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:01 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:38:01 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:01 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219.1daa8b01-3f6f-42c2-aa18-18230ae6b81c" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-quobyte-1daa8b01-3f6f-42c2-aa18-18230ae6b81c" released by "_delete_snapshot" :: held 3.105s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-quobyte-e89307b3-8e31-4be0-96be-7ed9e0efb219" released by "delete_snapshot" :: held 3.127s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Created reservations ['7314f5a5-1bfd-4838-9462-8058e0542045', '062e5275-5d6f-415f-bdb4-618290fbe859', '91be7960-1c54-4aa7-a229-e8131ee53126', '0f14ef6b-fda0-47ce-9231-d1f82f05f619'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Delete snapshot completed successfully. Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb3f5e8c-1ebd-412c-8d4c-dc9127b0ac2c tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-1daa8b01-3f6f-42c2-aa18-18230ae6b81c-delete_snapshot" released by "delete_snapshot" :: held 3.308s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Flow 'volume_create_manager' (1399430d-d6ef-4fc2-abf2-8af4af90c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8e17ab-8d7d-4a32-b755-b09332c8ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8e17ab-8d7d-4a32-b755-b09332c8ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-879426921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2430d03-7e0d-4fcd-934d-c277821d20bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e945b9076649f691bae89325649bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a6073d0f-5b48-4855-9b32-ac390a85718e,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:02Z,use_quota=True,user_id='c717180f583048879293de8b6fef3a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731b9e35-6d12-4aa1-a49c-d04ce432896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731b9e35-6d12-4aa1-a49c-d04ce432896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb95c37-804e-4e59-ade6-cd13d0564ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb95c37-804e-4e59-ade6-cd13d0564ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e2430d03-7e0d-4fcd-934d-c277821d20bd', 'volume_name': 'volume-e2430d03-7e0d-4fcd-934d-c277821d20bd', 'volume_size': 2, 'source_volid': 'a6073d0f-5b48-4855-9b32-ac390a85718e', 'source_volstatus': 'available'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806ed6fa-9f8e-4a0f-81ce-1afe28a9ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806ed6fa-9f8e-4a0f-81ce-1afe28a9ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f21e9e-e5cf-4d56-8d9b-533c1c48ee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Volume e2430d03-7e0d-4fcd-934d-c277821d20bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e2430d03-7e0d-4fcd-934d-c277821d20bd', 'volume_size': 2, 'source_volid': 'a6073d0f-5b48-4855-9b32-ac390a85718e', 'source_volstatus': 'available'} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:01 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:01 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 1G Jul 08 03:38:01 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "cinder-e89307b3-8e31-4be0-96be-7ed9e0efb219-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-e89307b3-8e31-4be0-96be-7ed9e0efb219-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "cinder-quobyte-e89307b3-8e31-4be0-96be-7ed9e0efb219" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-quobyte-e89307b3-8e31-4be0-96be-7ed9e0efb219" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:02 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 1G" returned: 0 in 0.803s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb80174-856a-41f2-99e5-3ba138fb3b25]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:02 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 Jul 08 03:38:02 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:02 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 Jul 08 03:38:02 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:03 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:03 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 is being set with open permissions: ugo+rw Jul 08 03:38:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:03 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 Jul 08 03:38:03 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:03 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:03 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219 Jul 08 03:38:03 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:04 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:04 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info Jul 08 03:38:04 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:04 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e89307b3-8e31-4be0-96be-7ed9e0efb219" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-quobyte-e89307b3-8e31-4be0-96be-7ed9e0efb219" released by "delete_volume" :: held 1.488s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Created reservations ['4ba6c561-1c7e-4e35-9dd0-9d6d56ffec5c', '128f4be1-5ad2-4f50-ae90-e181a9e9a333', 'ce5dbc90-f47f-4668-bb24-0f89b2fd6467', '7490f2cb-0973-4954-b03d-ae5ef0b50cad'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:04 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:04 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:04 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info" returned: 0 in 0.646s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:04 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info is being set with open permissions: ugo+rw Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:04 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info Jul 08 03:38:04 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:04 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.666s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:05 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Deleted volume successfully. Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-282e2d8b-19eb-463a-bc9f-03b23aebbedd tempest-SnapshotMetadataTestJSON-1941159623 None] Lock "cinder-e89307b3-8e31-4be0-96be-7ed9e0efb219-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:05 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.info" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-161cb0d5-f442-4d98-9125-e508a78733ec" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-161cb0d5-f442-4d98-9125-e508a78733ec" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] snapshot: 9a461797-c8e2-4b42-b04e-4b553d143761, volume: 161cb0d5-f442-4d98-9125-e508a78733ec, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e82927e-e5c6-4f95-8087-497197cbdc17]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:05 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 Jul 08 03:38:05 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:06 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761" returned: 0 in 0.780s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:38:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:38:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:38:06 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2d891f-fbb4-4643-acee-cf290e115b82]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:06 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:38:06 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:07 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.815s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:07 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:38:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:07 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec Jul 08 03:38:07 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:12 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec" returned: 0 in 5.148s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:12 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fa2be-54c4-415f-9d02-4a633e6e27b1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:12 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:38:12 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:13 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.979s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:13 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:38:13 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Converted 1024.00 MB image at 198.87 MB/s Jul 08 03:38:13 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec is being set with open permissions: ugo+rw Jul 08 03:38:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:13 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec Jul 08 03:38:13 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:13 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec" returned: 0 in 0.671s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-161cb0d5-f442-4d98-9125-e508a78733ec" released by "_copy_volume_from_snapshot" :: held 8.485s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=134,cinder:SELECT=107,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-9a461797-c8e2-4b42-b04e-4b553d143761" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-9a461797-c8e2-4b42-b04e-4b553d143761" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Deleting offline snapshot 9a461797-c8e2-4b42-b04e-4b553d143761 of volume ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] snapshot_file for this snap is: volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a781b-c591-458f-8100-1575768ff902]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:14 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 Jul 08 03:38:14 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:14 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761" returned: 0 in 0.797s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b7cb1-0303-47b6-990c-c560aa2340dd]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:15 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=60,cinder:UPDATE=82,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:38:15 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:38:15 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:15 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:15 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 Jul 08 03:38:15 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:16 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761" returned: 0 in 0.853s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:16 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761 Jul 08 03:38:16 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:17 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd.9a461797-c8e2-4b42-b04e-4b553d143761" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-9a461797-c8e2-4b42-b04e-4b553d143761" released by "_delete_snapshot" :: held 3.192s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.188s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.351s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:17 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Cloning volume a6073d0f-5b48-4855-9b32-ac390a85718e to volume e2430d03-7e0d-4fcd-934d-c277821d20bd Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e80ca5-4d0f-4072-81b8-e6fa57fc70d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161cb0d5-f442-4d98-9125-e508a78733ec', 'volume_size': 1, 'source_volid': 'ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd', 'source_volstatus': 'available'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1d5085-887e-4940-9eec-c4298d299dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Volume volume-161cb0d5-f442-4d98-9125-e508a78733ec (161cb0d5-f442-4d98-9125-e508a78733ec): created successfully Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1d5085-887e-4940-9eec-c4298d299dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (ef09ae11-0152-4570-ba02-7a9cd987af58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Creating offline snapshot a62b05f6-526c-4f56-a855-755ee52b227c of volume a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab66948-97b6-41f0-91fa-42e051e90ec2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fa35c6ac-0974-4a5b-b29a-17054a6f2acf tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:38:17 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:17 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:18 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.962s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:18 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c 1G Jul 08 03:38:18 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (4f45e36f-23c3-45a3-aa51-2f1fa85567c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9844c5-c98a-473c-90bd-ad9f98fba542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9844c5-c98a-473c-90bd-ad9f98fba542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-492776353',display_name='tempest-VolumesGetTest-Volume-525415496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c6122-7ae1-4001-9429-3f4dd9c83984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:18Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c1424a-230f-4a76-a7a2-6a80ebd0f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c1424a-230f-4a76-a7a2-6a80ebd0f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6086649d-7914-4d26-a81b-7a1ba9be093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6086649d-7914-4d26-a81b-7a1ba9be093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35c6122-7ae1-4001-9429-3f4dd9c83984', 'volume_name': 'volume-c35c6122-7ae1-4001-9429-3f4dd9c83984', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c13846e-2643-4f64-b416-132e0c993ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c13846e-2643-4f64-b416-132e0c993ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f28ac09-afd8-4ca1-97c6-8f7032ecc672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:18 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Volume c35c6122-7ae1-4001-9429-3f4dd9c83984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35c6122-7ae1-4001-9429-3f4dd9c83984', 'volume_size': 1} Jul 08 03:38:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:19 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c 1G" returned: 0 in 0.880s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6073d0f-5b48-4855-9b32-ac390a85718e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:19 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6073d0f-5b48-4855-9b32-ac390a85718e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c Jul 08 03:38:19 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:19 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6073d0f-5b48-4855-9b32-ac390a85718e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:19 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c is being set with open permissions: ugo+rw Jul 08 03:38:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:19 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c Jul 08 03:38:19 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:20 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c" returned: 0 in 0.650s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:20 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info Jul 08 03:38:20 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:21 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info" returned: 0 in 0.653s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:21 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info is being set with open permissions: ugo+rw Jul 08 03:38:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:21 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info Jul 08 03:38:21 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:21 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.info" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "cinder-quobyte-e2430d03-7e0d-4fcd-934d-c277821d20bd" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-e2430d03-7e0d-4fcd-934d-c277821d20bd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] snapshot: a62b05f6-526c-4f56-a855-755ee52b227c, volume: e2430d03-7e0d-4fcd-934d-c277821d20bd, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9ca6f-534e-4403-9e2f-04af38f0c35a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:22 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c Jul 08 03:38:22 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Flow 'volume_create_manager' (c2afb7ef-a61a-4d5f-bbe2-bea50ee9094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457aea78-96f7-4217-ad41-9935b651cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457aea78-96f7-4217-ad41-9935b651cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167325410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c5519a-ec9d-4608-abbf-7232efe52d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70380479955f476f9db209d412a58057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:23Z,use_quota=True,user_id='c90f1094912145feb3ffaac9270dcf44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9102946-9709-4c5a-849d-910114c8b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9102946-9709-4c5a-849d-910114c8b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e87de4e-4f34-4d9f-ad46-8935d01930c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e87de4e-4f34-4d9f-ad46-8935d01930c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c5519a-ec9d-4608-abbf-7232efe52d27', 'volume_name': 'volume-a3c5519a-ec9d-4608-abbf-7232efe52d27', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bbeee8-4049-4f18-9abb-371840301c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bbeee8-4049-4f18-9abb-371840301c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8e3d74-27d3-4a98-acbb-c853ce0b312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:22 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Volume a3c5519a-ec9d-4608-abbf-7232efe52d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c5519a-ec9d-4608-abbf-7232efe52d27', 'volume_size': 1} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:22 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6073d0f-5b48-4855-9b32-ac390a85718e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497c31d-dc14-4f4a-be14-8ebbfe5ff8b6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:22 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:22 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:23 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.742s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:23 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:38:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:23 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd Jul 08 03:38:23 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:28 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd" returned: 0 in 4.498s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd75dd37-ef6c-4be1-8332-86cbe5fc48b1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:28 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:28 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:29 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.888s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:38:29 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Converted 1024.00 MB image at 227.57 MB/s Jul 08 03:38:29 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd is being set with open permissions: ugo+rw Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:29 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd Jul 08 03:38:29 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:29 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd" returned: 0 in 0.620s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-e2430d03-7e0d-4fcd-934d-c277821d20bd" released by "_copy_volume_from_snapshot" :: held 7.621s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "cinder-quobyte-a62b05f6-526c-4f56-a855-755ee52b227c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-a62b05f6-526c-4f56-a855-755ee52b227c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Deleting offline snapshot a62b05f6-526c-4f56-a855-755ee52b227c of volume a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] snapshot_file for this snap is: volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8121a2bf-bd1b-4209-84c8-f26d2a99eb7b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:29 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c Jul 08 03:38:29 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:30 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c" returned: 0 in 0.745s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6073d0f-5b48-4855-9b32-ac390a85718e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:38:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cce391-0364-42fe-8e2a-dac035f42eba]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:30 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:30 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:31 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.728s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:31 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c Jul 08 03:38:31 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:31 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c" returned: 0 in 0.697s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:31 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c Jul 08 03:38:31 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:32 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e.a62b05f6-526c-4f56-a855-755ee52b227c" returned: 0 in 0.634s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-a62b05f6-526c-4f56-a855-755ee52b227c" released by "_delete_snapshot" :: held 2.880s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.294s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.024s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-492776353',display_name='tempest-VolumesGetTest-Volume-525415496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c6122-7ae1-4001-9429-3f4dd9c83984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:18Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Creating volume c35c6122-7ae1-4001-9429-3f4dd9c83984 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:38:32 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:32 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 1073741824 Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f21e9e-e5cf-4d56-8d9b-533c1c48ee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2430d03-7e0d-4fcd-934d-c277821d20bd', 'volume_size': 2, 'source_volid': 'a6073d0f-5b48-4855-9b32-ac390a85718e', 'source_volstatus': 'available'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:32 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608b80bb-6754-4b89-a243-3bdca8bd6c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:32 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Volume volume-e2430d03-7e0d-4fcd-934d-c277821d20bd (e2430d03-7e0d-4fcd-934d-c277821d20bd): created successfully Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608b80bb-6754-4b89-a243-3bdca8bd6c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Flow 'volume_create_manager' (1399430d-d6ef-4fc2-abf2-8af4af90c158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-913f28ee-5fba-45b6-9723-5156e66c6081 tempest-VolumesCloneTest-1752140044 None] Created volume successfully. Jul 08 03:38:33 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 1073741824" returned: 0 in 0.842s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:33 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 Jul 08 03:38:33 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "cinder-e2430d03-7e0d-4fcd-934d-c277821d20bd-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-e2430d03-7e0d-4fcd-934d-c277821d20bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "cinder-quobyte-e2430d03-7e0d-4fcd-934d-c277821d20bd" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-e2430d03-7e0d-4fcd-934d-c277821d20bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16bce84-59a0-4b81-a80f-020cf62434a1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:33 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd Jul 08 03:38:33 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:34 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984" returned: 0 in 0.672s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.391s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167325410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c5519a-ec9d-4608-abbf-7232efe52d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70380479955f476f9db209d412a58057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:23Z,use_quota=True,user_id='c90f1094912145feb3ffaac9270dcf44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Creating volume a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:38:34 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:34 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 1073741824 Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f28ac09-afd8-4ca1-97c6-8f7032ecc672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35c6122-7ae1-4001-9429-3f4dd9c83984', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:34 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4c9f45-40eb-45bc-b996-e366bbc45f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Volume volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 (c35c6122-7ae1-4001-9429-3f4dd9c83984): created successfully Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4c9f45-40eb-45bc-b996-e366bbc45f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (4f45e36f-23c3-45a3-aa51-2f1fa85567c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-daee4a31-8abf-4466-b907-d3a9bfebf825 tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:38:34 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:34 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd Jul 08 03:38:34 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-c35c6122-7ae1-4001-9429-3f4dd9c83984-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Lock "cinder-c35c6122-7ae1-4001-9429-3f4dd9c83984-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-c35c6122-7ae1-4001-9429-3f4dd9c83984" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-c35c6122-7ae1-4001-9429-3f4dd9c83984" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265a7c5-4ad0-4307-8800-a6f520bbb1fd]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:34 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 Jul 08 03:38:34 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:35 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 1073741824" returned: 0 in 0.876s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:35 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:38:35 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:35 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e2430d03-7e0d-4fcd-934d-c277821d20bd" returned: 0 in 0.707s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-e2430d03-7e0d-4fcd-934d-c277821d20bd" released by "delete_volume" :: held 1.542s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Created reservations ['f5aa75a2-c293-43d0-96c2-12476d3b42f6', 'c34f131a-ac99-4096-b9e1-2f2e58c79159', '9cfffb49-c144-45dc-9525-0ec77ea5f541', 'be1d15b1-01d0-419e-8f66-ea2642cc4e68'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:35 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:35 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:35 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:35 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984 Jul 08 03:38:35 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:35 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.711s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8e3d74-27d3-4a98-acbb-c853ce0b312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c5519a-ec9d-4608-abbf-7232efe52d27', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ebf39b-ba34-40ae-a2a7-d1737e4bb7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:35 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Volume volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 (a3c5519a-ec9d-4608-abbf-7232efe52d27): created successfully Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ebf39b-ba34-40ae-a2a7-d1737e4bb7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Flow 'volume_create_manager' (c2afb7ef-a61a-4d5f-bbe2-bea50ee9094b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-26e0adf8-9adb-4d7a-87db-3c33598544a7 tempest-VolumesActionsTest-1807173771 None] Created volume successfully. Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "cinder-a6073d0f-5b48-4855-9b32-ac390a85718e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-a6073d0f-5b48-4855-9b32-ac390a85718e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "cinder-quobyte-a6073d0f-5b48-4855-9b32-ac390a85718e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-a6073d0f-5b48-4855-9b32-ac390a85718e" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:35 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.697s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:35 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Deleted volume successfully. Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598cf3f-a005-4c26-a11c-25a7e817c618]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e4b92a6-abd8-4745-bee8-eb14ca069c97 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-e2430d03-7e0d-4fcd-934d-c277821d20bd-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:36 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:36 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:36 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c35c6122-7ae1-4001-9429-3f4dd9c83984" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-c35c6122-7ae1-4001-9429-3f4dd9c83984" released by "delete_volume" :: held 1.617s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Created reservations ['0faf5de3-1d69-4481-ad2a-fa179fa062d5', '8d846e9d-f092-4cd1-a91c-f2640d21276d', '314c4493-0383-4529-9ada-f143c760f957', '35be98f7-47e9-46c5-afa9-229dc95ee78c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:36 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:36 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:36 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.796s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:36 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e Jul 08 03:38:36 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-161cb0d5-f442-4d98-9125-e508a78733ec-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Lock "cinder-161cb0d5-f442-4d98-9125-e508a78733ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-161cb0d5-f442-4d98-9125-e508a78733ec" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-161cb0d5-f442-4d98-9125-e508a78733ec" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a873d3b-2fbc-4574-b1cf-410ce810e051]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:37 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.753s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-65731e5f-a10f-4dcc-8ff3-5b33eaa3d3fc tempest-VolumesGetTest-2052705606 None] Lock "cinder-c35c6122-7ae1-4001-9429-3f4dd9c83984-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:37 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec Jul 08 03:38:37 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:37 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a6073d0f-5b48-4855-9b32-ac390a85718e" returned: 0 in 0.745s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-quobyte-a6073d0f-5b48-4855-9b32-ac390a85718e" released by "delete_volume" :: held 1.617s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Created reservations ['0c70c40b-49e3-4bfc-9c11-263470f4c535', '5d45cc8f-4b86-4c84-b49b-188155221c90', '842e106c-029c-4227-b687-5a658f4fa58d', 'bbcc6860-6bf6-4611-b409-b88757ff9b19'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:37 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:37 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:38 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec" returned: 0 in 0.816s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:38 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec Jul 08 03:38:38 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:38 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.717s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Deleted volume successfully. Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-545c8414-88ee-47b2-8488-dfa94b6c87d8 tempest-VolumesCloneTest-1752140044 None] Lock "cinder-a6073d0f-5b48-4855-9b32-ac390a85718e-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:38 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-161cb0d5-f442-4d98-9125-e508a78733ec" returned: 0 in 0.761s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-161cb0d5-f442-4d98-9125-e508a78733ec" released by "delete_volume" :: held 1.646s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:38 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Created reservations ['6be0689e-46e0-4d75-b417-a47ebba31876', 'a571e625-65bd-4eda-b8ff-b0dd8186ce74', '1aa5a8cc-0273-43bd-9f32-d61c16e679de', '4fbc9f42-0060-46c8-a29f-0a0360e69d1f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:39 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:39 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Lock "cinder-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2e480d-34da-4815-bf4f-a17b57276d2e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:39 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.726s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:38:39 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:38:39 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d39d4bfa-3e8a-40fa-bc19-41ce429995ec tempest-VolumesGetTest-2052705606 None] Lock "cinder-161cb0d5-f442-4d98-9125-e508a78733ec-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:40 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.814s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:40 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd Jul 08 03:38:40 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:41 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" returned: 0 in 0.652s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd" released by "delete_volume" :: held 1.540s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Created reservations ['cd38862e-db04-4a24-aa5b-b800360ced6c', 'dbc7686a-4684-44cf-ad14-29283d43ae2a', '067dfab4-2e36-4d78-81fe-1cb64a612526', 'e251c371-607a-463a-8a04-87f14effe392'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:41 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:41 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Flow 'volume_create_manager' (80eb927c-0d3b-4b08-ae45-4817b67028cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e93c032-cb4b-479f-bf99-9f3ad27ce743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e93c032-cb4b-479f-bf99-9f3ad27ce743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-239786591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e802663a-7184-4e41-b860-65b7af598d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de408748632d46108eab026058791ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:41Z,use_quota=True,user_id='b680b7c054f14c8a91dadc2bbe1146ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136e94f0-54c1-4c30-a6d3-c63fd5e9a379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136e94f0-54c1-4c30-a6d3-c63fd5e9a379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fdae06-df79-4992-bcfb-d89b7eed4751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fdae06-df79-4992-bcfb-d89b7eed4751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e802663a-7184-4e41-b860-65b7af598d91', 'volume_name': 'volume-e802663a-7184-4e41-b860-65b7af598d91', 'volume_size': 2}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe9ae82-8186-477e-8378-a6839fae9c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe9ae82-8186-477e-8378-a6839fae9c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9863bfd-ccd3-4e48-9c5d-9bbf26386e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Volume e802663a-7184-4e41-b860-65b7af598d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e802663a-7184-4e41-b860-65b7af598d91', 'volume_size': 2} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-239786591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e802663a-7184-4e41-b860-65b7af598d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de408748632d46108eab026058791ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:41Z,use_quota=True,user_id='b680b7c054f14c8a91dadc2bbe1146ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Creating volume e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:38:41 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:38:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 2147483648 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:41 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 2147483648 Jul 08 03:38:41 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:42 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c8c9823f-ea94-4bcf-87a8-dc9d3f467949 tempest-VolumesGetTest-2052705606 None] Lock "cinder-ce81306e-4e6c-4eac-9ba6-33f29ce8f3fd-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:42 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 2147483648" returned: 0 in 0.963s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:42 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 Jul 08 03:38:42 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (9fa2cb22-d0b9-42db-9b7e-1980b1d0826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3bff4e-b563-46e5-ac09-51948a7937b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3bff4e-b563-46e5-ac09-51948a7937b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-186891278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:43Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5271b6a5-0a15-4f19-856d-7eb3c412e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5271b6a5-0a15-4f19-856d-7eb3c412e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d042d8-3130-49c2-8ae7-257eee4c3db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:42 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d042d8-3130-49c2-8ae7-257eee4c3db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6', 'volume_name': 'volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9083fdc9-2687-4772-ae9c-1861cff3a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9083fdc9-2687-4772-ae9c-1861cff3a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabe35f5-81f1-4cd5-9e2d-c3f99dfab260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:43 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Volume 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Trying to clone 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 from image ad206503-c10d-4ca1-92a8-b1a38f579b05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:38:43 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91" returned: 0 in 0.728s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9863bfd-ccd3-4e48-9c5d-9bbf26386e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e802663a-7184-4e41-b860-65b7af598d91', 'volume_size': 2}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbc4d71-e50a-4a4b-87b3-998023b8ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:43 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Volume volume-e802663a-7184-4e41-b860-65b7af598d91 (e802663a-7184-4e41-b860-65b7af598d91): created successfully Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbc4d71-e50a-4a4b-87b3-998023b8ad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Flow 'volume_create_manager' (80eb927c-0d3b-4b08-ae45-4817b67028cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c3545d41-2194-40f5-a8a1-ef5897691b2d tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Created volume successfully. Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:38:43 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Image download 20.69 MB at 20.69 MB/s Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1b5ae-f7a0-453d-9302-5cadf8cd6802]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:43 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD Jul 08 03:38:43 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Creating offline snapshot 7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 of volume e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a320d7-b1db-4f61-aa1b-763365903eb8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:44 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 Jul 08 03:38:44 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:44 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD" returned: 0 in 0.931s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:44 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 is fetched for user c76013b430c84ee184a0c4fa35831c69. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:38:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[058e0914-2eea-4d52-8b38-456b1ec338bd]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:44 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD Jul 08 03:38:44 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:44 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91" returned: 0 in 0.825s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 2G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:44 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 2G Jul 08 03:38:44 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:45 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD" returned: 0 in 0.940s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:45 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 2G" returned: 0 in 0.886s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e802663a-7184-4e41-b860-65b7af598d91 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:45 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e802663a-7184-4e41-b860-65b7af598d91 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 Jul 08 03:38:45 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:46 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e802663a-7184-4e41-b860-65b7af598d91 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" returned: 0 in 0.693s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:46 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 is being set with open permissions: ugo+rw Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:46 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 Jul 08 03:38:46 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:47 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:47 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:47 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:47 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info Jul 08 03:38:47 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:47 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.662s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:38:47 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info" returned: 0 in 0.673s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:47 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info is being set with open permissions: ugo+rw Jul 08 03:38:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:47 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info Jul 08 03:38:47 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:48 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.info" returned: 0 in 0.632s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.442s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-186891278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:38:43Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Creating volume 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:38:48 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:38:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:48 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 1073741824 Jul 08 03:38:48 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9a1a35b5-2c0b-4743-82a4-0cd4409f2dd6 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Create snapshot completed successfully Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "cinder-7a1bb0a7-4ee7-47b1-8f03-6293582f7e21-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-7a1bb0a7-4ee7-47b1-8f03-6293582f7e21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "cinder-quobyte-e802663a-7184-4e41-b860-65b7af598d91" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-quobyte-e802663a-7184-4e41-b860-65b7af598d91" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "cinder-quobyte-7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-quobyte-7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Deleting offline snapshot 7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 of volume e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] snapshot_file for this snap is: volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d2734-e092-423e-b8f1-057aaef95c8a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:49 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:49 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 1073741824" returned: 0 in 1.192s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:49 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:49 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:38:49 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:50 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" returned: 0 in 0.799s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e802663a-7184-4e41-b860-65b7af598d91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:38:50 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eacee8-a3e0-40b7-8d1e-ae5562fbb45b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Attempting download of ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[285f2979-78b9-40b5-826d-b7729a9ece77]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:50 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 Jul 08 03:38:50 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:50 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt Jul 08 03:38:50 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:51 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91" returned: 0 in 0.829s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:51 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 Jul 08 03:38:51 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:51 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt" returned: 0 in 0.761s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:51 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt Jul 08 03:38:51 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:52 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" returned: 0 in 0.857s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:52 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21 Jul 08 03:38:52 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:52 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt" returned: 1 in 0.905s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_0w3yflpt' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39678db-9acb-44bc-844a-1a1ee7b69a05]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:52 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD Jul 08 03:38:52 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:52 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91.7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" returned: 0 in 0.722s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-quobyte-7a1bb0a7-4ee7-47b1-8f03-6293582f7e21" released by "_delete_snapshot" :: held 3.354s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-quobyte-e802663a-7184-4e41-b860-65b7af598d91" released by "delete_snapshot" :: held 3.386s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Created reservations ['a92e6449-5f4a-4002-9061-c81eb78e0939', '364826ba-1893-42ce-856b-d60c0b032ff8', '5b47dd2f-d7a9-4da2-9af7-bf4eb6348cb8', '60b5170b-5672-4a4f-9a8c-6c6ae9d77e88'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:52 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] ad206503-c10d-4ca1-92a8-b1a38f579b05 was qcow2, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:38:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:53 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:38:53 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Delete snapshot completed successfully. Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0db74a7b-649d-4686-a334-0e7836774217 tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-7a1bb0a7-4ee7-47b1-8f03-6293582f7e21-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-28d94592-ca1f-4b18-848c-518b5559f690 tempest-VolumesActionsTest-1807173771 None] Acquiring lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27" by "attach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-28d94592-ca1f-4b18-848c-518b5559f690 tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27" acquired by "attach_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-28d94592-ca1f-4b18-848c-518b5559f690 tempest-VolumesActionsTest-1807173771 None] Attaching volume a3c5519a-ec9d-4608-abbf-7232efe52d27 to instance 7eca7a2c-ecbd-4036-954c-a8095e59e5b3 at mountpoint /dev/vdb on host None. Jul 08 03:38:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-28d94592-ca1f-4b18-848c-518b5559f690 tempest-VolumesActionsTest-1807173771 None] Attach volume completed successfully. Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-28d94592-ca1f-4b18-848c-518b5559f690 tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27" released by "attach_volume" :: held 0.117s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8669d6d1-7ace-4702-b47a-e04e5d4d54a6 tempest-VolumesActionsTest-1807173771 None] Acquiring lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-detach_volume" by "detach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8669d6d1-7ace-4702-b47a-e04e5d4d54a6 tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8669d6d1-7ace-4702-b47a-e04e5d4d54a6 tempest-VolumesActionsTest-1807173771 None] Detaching volume a3c5519a-ec9d-4608-abbf-7232efe52d27 from instance 7eca7a2c-ecbd-4036-954c-a8095e59e5b3. Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "cinder-e802663a-7184-4e41-b860-65b7af598d91-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-e802663a-7184-4e41-b860-65b7af598d91-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8669d6d1-7ace-4702-b47a-e04e5d4d54a6 tempest-VolumesActionsTest-1807173771 None] Detach volume completed successfully. Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8669d6d1-7ace-4702-b47a-e04e5d4d54a6 tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "cinder-quobyte-e802663a-7184-4e41-b860-65b7af598d91" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-quobyte-e802663a-7184-4e41-b860-65b7af598d91" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d188ef6-673c-4589-be65-4d627254dc7c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:54 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 Jul 08 03:38:54 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:54 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91" returned: 0 in 0.872s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:54 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91 Jul 08 03:38:54 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:55 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 0 in 2.298s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_5tst_t8wdevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:38:55 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Converted 112.00 MB image at 48.70 MB/s Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:55 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 1G Jul 08 03:38:55 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:55 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e802663a-7184-4e41-b860-65b7af598d91" returned: 0 in 0.702s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-quobyte-e802663a-7184-4e41-b860-65b7af598d91" released by "delete_volume" :: held 1.652s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Created reservations ['f7d2f3d7-7661-4398-ac1f-53c8decaa268', '2309226f-83a0-4bac-9bff-f8a0a868b7d4', '0a3f7edd-3dbf-4286-8a43-f1b89bf15883', 'dc3ce146-d686-4c92-9737-0c6efe79dbe3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:55 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:38:55 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:55 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 1G" returned: 0 in 0.692s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6553c3b-b985-43cb-9733-9e0e04d24983]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:38:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:56 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:38:56 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:56 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.802s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:56 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:38:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Deleted volume successfully. Jul 08 03:38:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2ef52cb0-c55f-425d-a948-de936e3aab6b tempest-VolumesSnapshotNegativeTestJSON-632180141 None] Lock "cinder-e802663a-7184-4e41-b860-65b7af598d91-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:38:57 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 0 in 1.065s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:57 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:38:57 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:38:57 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 1 in 0.867s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Downloaded image ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 for user c76013b430c84ee184a0c4fa35831c69 is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Marking volume 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Copying metadata from image ad206503-c10d-4ca1-92a8-b1a38f579b05 to 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:38:57 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Creating volume glance metadata for volume 563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 backed by image ad206503-c10d-4ca1-92a8-b1a38f579b05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:38:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabe35f5-81f1-4cd5-9e2d-c3f99dfab260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb3bd1c-836b-402a-93d6-1c91251def3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:58 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Volume volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 (563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6): created successfully Jul 08 03:38:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb3bd1c-836b-402a-93d6-1c91251def3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (9fa2cb22-d0b9-42db-9b7e-1980b1d0826b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-87308fc1-4f2d-4c4f-bff8-88b40942f017 tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (639d2804-b96b-464c-a9fe-22acaaf7ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ce04a2-2722-44f8-96db-a29f466ece48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ce04a2-2722-44f8-96db-a29f466ece48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-702792975',display_name='tempest-VolumesGetTest-Volume-1167117076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfd043e-c834-4f9a-ac51-f9701505ce04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:00Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40118230-c260-429d-831e-3edd53aa6d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40118230-c260-429d-831e-3edd53aa6d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb8c82b-7a3c-49c0-a399-8e20f1741cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb8c82b-7a3c-49c0-a399-8e20f1741cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfd043e-c834-4f9a-ac51-f9701505ce04', 'volume_name': 'volume-5cfd043e-c834-4f9a-ac51-f9701505ce04', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b2d216-012a-46e9-8cfe-b824a1ce5049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b2d216-012a-46e9-8cfe-b824a1ce5049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b04703c-b932-4083-92ac-9afecfb91ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:38:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Volume 5cfd043e-c834-4f9a-ac51-f9701505ce04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfd043e-c834-4f9a-ac51-f9701505ce04', 'volume_size': 1} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:38:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-702792975',display_name='tempest-VolumesGetTest-Volume-1167117076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfd043e-c834-4f9a-ac51-f9701505ce04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea4120eee984f098affe8b6dd1a2c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:00Z,use_quota=True,user_id='c76013b430c84ee184a0c4fa35831c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Creating volume 5cfd043e-c834-4f9a-ac51-f9701505ce04 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:38:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:38:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:38:59 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 1073741824 Jul 08 03:38:59 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:00 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 1073741824" returned: 0 in 0.894s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:00 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 Jul 08 03:39:00 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:01 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b04703c-b932-4083-92ac-9afecfb91ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfd043e-c834-4f9a-ac51-f9701505ce04', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc3ca39-cbd6-45d2-bf80-44697d0cdb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Volume volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 (5cfd043e-c834-4f9a-ac51-f9701505ce04): created successfully Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc3ca39-cbd6-45d2-bf80-44697d0cdb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Flow 'volume_create_manager' (639d2804-b96b-464c-a9fe-22acaaf7ab15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1aa606f8-00cc-437e-9b14-01b97398decc tempest-VolumesGetTest-2052705606 None] Created volume successfully. Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-5cfd043e-c834-4f9a-ac51-f9701505ce04-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Lock "cinder-5cfd043e-c834-4f9a-ac51-f9701505ce04-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-5cfd043e-c834-4f9a-ac51-f9701505ce04" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-5cfd043e-c834-4f9a-ac51-f9701505ce04" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a6bba2-5196-42d6-ad9a-ee776c899319]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:02 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 Jul 08 03:39:02 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:02 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04" returned: 0 in 0.873s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:02 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04 Jul 08 03:39:02 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:03 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5cfd043e-c834-4f9a-ac51-f9701505ce04" returned: 0 in 0.899s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-5cfd043e-c834-4f9a-ac51-f9701505ce04" released by "delete_volume" :: held 1.830s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Created reservations ['b1b0a601-9fa0-4543-a500-e7eeb9c5d01d', 'b4cf4874-9bc8-4a9f-a782-ce9cd50495a3', '4ba16ed3-6257-411e-bc79-7e67f56b4f2e', '2839faa2-6eb2-4f3f-9885-a97842103926'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:03 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:39:03 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Lock "cinder-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Acquiring lock "cinder-quobyte-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" acquired by "delete_volume" :: waited 0.037s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f640c-5157-4cd4-8ca5-67ac833853d1]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:04 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:39:04 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:04 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.918s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:39:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:39:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2c2d02aa-1aa5-43ac-ad36-5ff20faeed09 tempest-VolumesGetTest-2052705606 None] Lock "cinder-5cfd043e-c834-4f9a-ac51-f9701505ce04-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:39:05 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 0 in 0.879s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:05 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:39:05 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:06 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 1 in 0.844s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:39:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:06 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6 Jul 08 03:39:06 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:06 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" returned: 0 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Lock "cinder-quobyte-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6" released by "delete_volume" :: held 2.566s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:39:06 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Created reservations ['f1e55d8b-4b9d-48dc-8c88-83474abaa9e2', '59d69049-2c1e-4a20-aae2-d76545b87ed3', 'a20fabb3-0fd3-4e28-948a-b6e435480f5f', '880c8c1a-d2d9-42cf-9a2a-23bd32516d64'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:07 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:39:07 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:07 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:39:07 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Deleted volume successfully. Jul 08 03:39:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d1ff321b-a361-4a71-a5c8-24aa331d21e7 tempest-VolumesGetTest-2052705606 None] Lock "cinder-563356ab-a34a-46e9-aa5f-ee7c7e6fcdb6-delete_volume" released by "delete_volume" :: held 3.729s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=101,cinder:SELECT=75,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=95,cinder:SELECT=80,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Flow 'volume_create_manager' (613f587f-18c2-4d11-a5ba-aaeb16dc1b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400eec73-df50-4a41-a78f-3153ff0f59eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400eec73-df50-4a41-a78f-3153ff0f59eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1653227466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e80298f-7339-485a-aebb-de138468862e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44aaee18f634eb7bf828e33c0805aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:15Z,use_quota=True,user_id='a3cfdad142e6428299fe9dfbc4df1b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4208b359-2bb9-4513-a65f-816fa5fb5444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4208b359-2bb9-4513-a65f-816fa5fb5444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875c409a-fe83-42b6-9c9f-f8d0e1572479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875c409a-fe83-42b6-9c9f-f8d0e1572479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e80298f-7339-485a-aebb-de138468862e', 'volume_name': 'volume-9e80298f-7339-485a-aebb-de138468862e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb054d65-a184-454d-a0ad-fb9850b4e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb054d65-a184-454d-a0ad-fb9850b4e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5e48ef-a67d-47f6-9949-cd71dadcd3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Volume 9e80298f-7339-485a-aebb-de138468862e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e80298f-7339-485a-aebb-de138468862e', 'volume_size': 1} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1653227466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e80298f-7339-485a-aebb-de138468862e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a44aaee18f634eb7bf828e33c0805aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:15Z,use_quota=True,user_id='a3cfdad142e6428299fe9dfbc4df1b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Creating volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:39:15 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:39:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:15 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e 1073741824 Jul 08 03:39:15 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:16 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e 1073741824" returned: 0 in 1.249s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:16 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e Jul 08 03:39:16 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:17 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e" returned: 0 in 0.770s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5e48ef-a67d-47f6-9949-cd71dadcd3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e80298f-7339-485a-aebb-de138468862e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edb3d58-aa30-4e2a-9ac7-9e4054f52fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Volume volume-9e80298f-7339-485a-aebb-de138468862e (9e80298f-7339-485a-aebb-de138468862e): created successfully Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edb3d58-aa30-4e2a-9ac7-9e4054f52fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Flow 'volume_create_manager' (613f587f-18c2-4d11-a5ba-aaeb16dc1b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-afb14328-8300-4575-a2cd-d4e60ff21396 tempest-VolumesSnapshotListTestJSON-1455346490 None] Created volume successfully. Jul 08 03:39:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Creating offline snapshot c09eab51-9fbf-407a-a446-485f33595140 of volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:39:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd82da1-23b4-4be7-b6e8-cf610b2925c4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:18 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e Jul 08 03:39:18 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e3d871f-3e2d-405f-a270-c051ed4914c1 tempest-VolumesActionsTest-1807173771 None] Acquiring lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27" by "attach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e3d871f-3e2d-405f-a270-c051ed4914c1 tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27" acquired by "attach_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:39:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9e3d871f-3e2d-405f-a270-c051ed4914c1 tempest-VolumesActionsTest-1807173771 None] Attaching volume a3c5519a-ec9d-4608-abbf-7232efe52d27 to instance 07801124-c334-4dfa-8050-827635d99c7a at mountpoint /dev/vdb on host None. Jul 08 03:39:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9e3d871f-3e2d-405f-a270-c051ed4914c1 tempest-VolumesActionsTest-1807173771 None] Attach volume completed successfully. Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e3d871f-3e2d-405f-a270-c051ed4914c1 tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27" released by "attach_volume" :: held 0.267s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Flow 'volume_create_manager' (3cefd1bb-82b5-4b49-8e90-44defd26d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02562cbc-c0c3-487f-bfe1-48d039564bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02562cbc-c0c3-487f-bfe1-48d039564bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1293947304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd1ce09-5dec-4d80-b762-465d9a9ef06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325dd3db02c1458bb90065996562b534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:20Z,use_quota=True,user_id='fd94a24840c54f2e80493515bb4e8ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02daff59-4693-4877-96a7-012c617b9f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02daff59-4693-4877-96a7-012c617b9f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc424285-35b9-4550-bbf9-88901fe4b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc424285-35b9-4550-bbf9-88901fe4b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd1ce09-5dec-4d80-b762-465d9a9ef06d', 'volume_name': 'volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb2c209-6bcf-4bad-a6a0-e9f26c3b04ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb2c209-6bcf-4bad-a6a0-e9f26c3b04ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ac8451-3544-4f7b-91b5-e7e8189960ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Volume edd1ce09-5dec-4d80-b762-465d9a9ef06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d', 'volume_size': 1} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:20 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e" returned: 0 in 1.322s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6463812-81db-4adb-91f6-00dc3a0f103b tempest-VolumesActionsTest-1807173771 None] Acquiring lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-detach_volume" by "detach_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:39:20 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 1G Jul 08 03:39:20 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6463812-81db-4adb-91f6-00dc3a0f103b tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:39:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c6463812-81db-4adb-91f6-00dc3a0f103b tempest-VolumesActionsTest-1807173771 None] Detaching volume a3c5519a-ec9d-4608-abbf-7232efe52d27 from instance 07801124-c334-4dfa-8050-827635d99c7a. Jul 08 03:39:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c6463812-81db-4adb-91f6-00dc3a0f103b tempest-VolumesActionsTest-1807173771 None] Detach volume completed successfully. Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6463812-81db-4adb-91f6-00dc3a0f103b tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-detach_volume" released by "detach_volume" :: held 0.137s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Flow 'volume_create_manager' (12fa45a1-15a6-4b03-be58-b6de1ffdc407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a89676-65af-46c4-9001-a0bafaf49110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a89676-65af-46c4-9001-a0bafaf49110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-256312287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1025e868-3392-4b77-b7c9-788fa6443069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325dd3db02c1458bb90065996562b534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:20Z,use_quota=True,user_id='fd94a24840c54f2e80493515bb4e8ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b79c68-19ea-4c0f-801a-0e7821c9d68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b79c68-19ea-4c0f-801a-0e7821c9d68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80de250e-08ce-481b-9af1-3b0055faffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80de250e-08ce-481b-9af1-3b0055faffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1025e868-3392-4b77-b7c9-788fa6443069', 'volume_name': 'volume-1025e868-3392-4b77-b7c9-788fa6443069', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521e408f-32e5-4223-b86b-cfbcc6778ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521e408f-32e5-4223-b86b-cfbcc6778ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67867e60-c7c1-4f21-a628-c1eebb3961b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Volume 1025e868-3392-4b77-b7c9-788fa6443069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1025e868-3392-4b77-b7c9-788fa6443069', 'volume_size': 1} Jul 08 03:39:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:21 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 1G" returned: 0 in 1.129s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:21 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:39:21 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:22 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:22 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 is being set with open permissions: ugo+rw Jul 08 03:39:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:22 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:39:22 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:22 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.695s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:22 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info Jul 08 03:39:22 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:23 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info" returned: 0 in 0.726s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:23 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info is being set with open permissions: ugo+rw Jul 08 03:39:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:23 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info Jul 08 03:39:23 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:24 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.info" returned: 0 in 0.744s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.603s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1293947304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd1ce09-5dec-4d80-b762-465d9a9ef06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325dd3db02c1458bb90065996562b534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:20Z,use_quota=True,user_id='fd94a24840c54f2e80493515bb4e8ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Creating volume edd1ce09-5dec-4d80-b762-465d9a9ef06d {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:39:24 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:39:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:24 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d 1073741824 Jul 08 03:39:24 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0c1f594f-40e0-414c-9126-4a47f962829f tempest-VolumesSnapshotListTestJSON-1455346490 None] Create snapshot completed successfully Jul 08 03:39:25 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d 1073741824" returned: 0 in 0.889s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:25 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d Jul 08 03:39:25 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:26 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d" returned: 0 in 0.717s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.431s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-256312287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1025e868-3392-4b77-b7c9-788fa6443069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325dd3db02c1458bb90065996562b534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:39:20Z,use_quota=True,user_id='fd94a24840c54f2e80493515bb4e8ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Creating volume 1025e868-3392-4b77-b7c9-788fa6443069 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:39:26 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:26 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 1073741824 Jul 08 03:39:26 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ac8451-3544-4f7b-91b5-e7e8189960ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4dcf02-3125-428e-ba20-e898c97d1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:26 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Volume volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d (edd1ce09-5dec-4d80-b762-465d9a9ef06d): created successfully Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4dcf02-3125-428e-ba20-e898c97d1e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Flow 'volume_create_manager' (3cefd1bb-82b5-4b49-8e90-44defd26d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-81043bef-583f-4f71-ad93-bf7087f96e9d tempest-TestServerVolumeAttachmentScenario-1428318492 None] Created volume successfully. Jul 08 03:39:26 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 1073741824" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:26 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 Jul 08 03:39:26 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:27 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069" returned: 0 in 0.681s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.126s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67867e60-c7c1-4f21-a628-c1eebb3961b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1025e868-3392-4b77-b7c9-788fa6443069', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4be4277-bfe6-4a8d-93f2-98f3b7e083b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Creating offline snapshot 048864b1-d291-4bf0-84f4-b6ac9659965c of volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:39:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Volume volume-1025e868-3392-4b77-b7c9-788fa6443069 (1025e868-3392-4b77-b7c9-788fa6443069): created successfully Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4be4277-bfe6-4a8d-93f2-98f3b7e083b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Flow 'volume_create_manager' (12fa45a1-15a6-4b03-be58-b6de1ffdc407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fd8b96-f39f-4e2e-8aad-e768a93f7692]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-83446c40-b93d-46ee-8ad4-ef906e9240d4 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Created volume successfully. Jul 08 03:39:27 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:39:27 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:28 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.770s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:39:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:28 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c 1G Jul 08 03:39:28 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:29 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c 1G" returned: 0 in 0.974s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:29 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:39:29 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:30 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 0.922s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:30 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c is being set with open permissions: ugo+rw Jul 08 03:39:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:30 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:39:30 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:31 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.523s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-acd012d1-7be5-4477-8c59-180863cb3094 tempest-VolumesSnapshotListTestJSON-1455346490 None] Create snapshot completed successfully Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2daef68-e4f7-4a54-956c-fe1755befaa4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:31 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:39:31 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:32 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.789s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1241eb-3a75-4ee2-9117-9f0419af3c19]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:32 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:39:32 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:32 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.758s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.e88b1873-1446-4546-9991-a54ccd10c139mjj1_aar.img {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:33 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.e88b1873-1446-4546-9991-a54ccd10c139mjj1_aar.img Jul 08 03:39:33 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:39 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.e88b1873-1446-4546-9991-a54ccd10c139mjj1_aar.img" returned: 0 in 6.173s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef526d-5756-40a4-b293-76ad14c807d8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:39 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:39:39 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:40 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.962s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:40 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.e88b1873-1446-4546-9991-a54ccd10c139mjj1_aar.img {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:39:40 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Converted 1024.00 MB image at 165.84 MB/s Jul 08 03:39:40 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] e88b1873-1446-4546-9991-a54ccd10c139 was raw, no need to convert to raw {{(pid=86294) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:47 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:39:47 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:39:47 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 08 03:39:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.872s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:39:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:39:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:39:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:39:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:39:50 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=21,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:39:50 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:39:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.780s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:39:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Uploaded volume to glance image-id: e88b1873-1446-4546-9991-a54ccd10c139. {{(pid=86294) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 03:39:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 27.329s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:39:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Creating offline snapshot c67e0c48-c6d9-42cb-997c-476141fafc73 of volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:39:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d8d7c3c4-c988-480f-801e-af41b201ce2d tempest-VolumesActionsTest-1807173771 None] Copy volume to image completed successfully. Jul 08 03:39:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d68f84-d3aa-40dc-bb03-e424e4cbc0d7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:39:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:39:59 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:39:59 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:00 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 0.794s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:40:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:00 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 1G Jul 08 03:40:00 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:00 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 1G" returned: 0 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:00 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 Jul 08 03:40:00 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:01 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:01 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 is being set with open permissions: ugo+rw Jul 08 03:40:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:01 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 Jul 08 03:40:01 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:02 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.867s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcae0abe-c1cc-490c-b4ba-7d27bb2f2056]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e7a764c9-e2ab-4d46-85d6-24f62a9656d4 tempest-VolumesSnapshotListTestJSON-1455346490 None] Create snapshot completed successfully Jul 08 03:40:02 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:40:02 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:03 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:03 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f3c94-59cb-44f7-8600-3eee08d6440a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:03 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:40:03 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:03 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.828s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:04 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img Jul 08 03:40:04 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-c67e0c48-c6d9-42cb-997c-476141fafc73-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-c67e0c48-c6d9-42cb-997c-476141fafc73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-c67e0c48-c6d9-42cb-997c-476141fafc73" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-c67e0c48-c6d9-42cb-997c-476141fafc73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Deleting offline snapshot c67e0c48-c6d9-42cb-997c-476141fafc73 of volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] snapshot_file for this snap is: volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[59924e5b-0a38-442a-bec2-934f823bb86c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:04 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 Jul 08 03:40:04 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:05 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73" returned: 0 in 1.173s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:40:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[66848cd2-b636-4c21-8b62-f2ade26d0f3d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:05 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:40:05 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:06 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 1.466s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:40:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:06 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 Jul 08 03:40:06 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:08 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73" returned: 0 in 1.674s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:08 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73 Jul 08 03:40:08 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:08 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img" returned: 0 in 4.862s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:08 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c57cea9-43d6-4da7-aaed-c0c5bc5fe688]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:08 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:40:08 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:09 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c67e0c48-c6d9-42cb-997c-476141fafc73" returned: 0 in 0.713s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-c67e0c48-c6d9-42cb-997c-476141fafc73" released by "_delete_snapshot" :: held 5.165s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" released by "delete_snapshot" :: held 5.190s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Created reservations ['1e88509d-1127-49ac-93b9-bec6e087a2fc', 'a6dc1d48-5d9f-4a8b-9b72-0036953e4c4f', '922ef7c0-9088-40d5-9153-29fef04bfcc6', 'e1b6cf3c-dc5c-4a7e-9f60-cf8de308a3e3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:09 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Delete snapshot completed successfully. Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2a5e4e1b-c4f7-4494-8600-9dd664323c18 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-c67e0c48-c6d9-42cb-997c-476141fafc73-delete_snapshot" released by "delete_snapshot" :: held 5.327s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:09 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.913s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:40:09 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Converted 1024.00 MB image at 210.53 MB/s Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] 4fdb2626-a723-4a49-be09-377342c8ed0c was raw, converting to qcow2 {{(pid=86294) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140b348-39bb-44d8-83c0-1cf9a74bb195]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:09 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img Jul 08 03:40:09 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-048864b1-d291-4bf0-84f4-b6ac9659965c-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-048864b1-d291-4bf0-84f4-b6ac9659965c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-048864b1-d291-4bf0-84f4-b6ac9659965c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-048864b1-d291-4bf0-84f4-b6ac9659965c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Deleting offline snapshot 048864b1-d291-4bf0-84f4-b6ac9659965c of volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] snapshot_file for this snap is: volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b20628-4b8a-4ed5-a425-5d4472de28bd]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:10 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:40:10 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:10 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img" returned: 0 in 0.715s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:10 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img Jul 08 03:40:10 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:11 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 0.763s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff0c76-42d3-49cd-86bb-b591892110f6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:11 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img" returned: 1 in 0.718s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:11 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf Jul 08 03:40:11 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:11 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:40:11 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:11 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Image conversion details: src /opt/stack/data/cinder/conversion/a3c5519a-ec9d-4608-abbf-7232efe52d27.temp_image.4fdb2626-a723-4a49-be09-377342c8ed0co55y36md.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:40:11 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b1c15b-a68d-4e45-b1fa-7e88dc92167c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:11 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:40:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:11 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:40:11 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:12 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf Jul 08 03:40:12 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:12 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eqzcusqf" returned: 0 in 0.719s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:12 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:12 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c Jul 08 03:40:12 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:13 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.048864b1-d291-4bf0-84f4-b6ac9659965c" returned: 0 in 0.701s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-048864b1-d291-4bf0-84f4-b6ac9659965c" released by "_delete_snapshot" :: held 3.133s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" released by "delete_snapshot" :: held 3.157s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Created reservations ['4cf26498-b5f0-4a38-9d65-c03d0943ca9d', '55fff9dd-68e5-4f13-a9f4-714b239ae2f3', 'e14db1d6-85d6-45a5-967f-0995acd998e4', '99772dee-81f9-439a-8bb9-5ad59430d4a6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Delete snapshot completed successfully. Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-17ad8f11-c975-468f-b08d-e3dde3b892b1 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-048864b1-d291-4bf0-84f4-b6ac9659965c-delete_snapshot" released by "delete_snapshot" :: held 3.600s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.612s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Uploaded volume to glance image-id: 4fdb2626-a723-4a49-be09-377342c8ed0c. {{(pid=86294) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.525s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbbcf58-b5b0-47c5-8416-4d4961c3640a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f1bf752e-b6b4-4b4a-99b8-12c9f06e92db tempest-VolumesActionsTest-1807173771 None] Copy volume to image completed successfully. Jul 08 03:40:14 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d Jul 08 03:40:14 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-c09eab51-9fbf-407a-a446-485f33595140-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-c09eab51-9fbf-407a-a446-485f33595140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-c09eab51-9fbf-407a-a446-485f33595140" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-c09eab51-9fbf-407a-a446-485f33595140" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Deleting offline snapshot c09eab51-9fbf-407a-a446-485f33595140 of volume 9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] snapshot_file for this snap is: volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[60319ce4-7c49-4466-9387-ba3b48e99d25]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Acquiring lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:14 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d" returned: 0 in 0.850s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Acquiring lock "cinder-quobyte-a3c5519a-ec9d-4608-abbf-7232efe52d27" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:14 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:40:14 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Lock "cinder-quobyte-a3c5519a-ec9d-4608-abbf-7232efe52d27" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '384682c6-2490-482b-b3de-553f4e8ba60d', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4925739-f6e2-4214-900e-5e3b04d35bff]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-e9a6b217-715b-4917-9e67-306f838d877d req-a70fd20a-6b3d-47e7-9258-f57b25c621b0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] attachment_update completed successfully. Jul 08 03:40:14 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:40:14 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:15 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e80298f-7339-485a-aebb-de138468862e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:40:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7943e88f-9734-40fb-bb79-f22ed3aa1ae6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:15 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e Jul 08 03:40:15 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:15 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:15 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27 Jul 08 03:40:15 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:16 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:16 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a3c5519a-ec9d-4608-abbf-7232efe52d27" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:16 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:40:16 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Lock "cinder-quobyte-a3c5519a-ec9d-4608-abbf-7232efe52d27" released by "delete_volume" :: held 1.538s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Created reservations ['4389708e-cd46-402c-a638-8afec506508c', '0b486c1a-674f-492b-b1f7-912322c9d56d', 'bde6279a-72c0-4367-a2ee-ad0fda71232c', 'cf43c26b-065b-4dc5-9854-237b89792f8b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:16 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:16 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:17 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.792s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:17 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140 Jul 08 03:40:17 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:17 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.709s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Deleted volume successfully. Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c7d7db88-62b8-41ed-95e0-9bdafdfeda0b tempest-VolumesActionsTest-1807173771 None] Lock "cinder-a3c5519a-ec9d-4608-abbf-7232efe52d27-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:17 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e.c09eab51-9fbf-407a-a446-485f33595140" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-c09eab51-9fbf-407a-a446-485f33595140" released by "_delete_snapshot" :: held 3.198s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" released by "delete_snapshot" :: held 3.231s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:17 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Created reservations ['8de7e22f-61d8-4cc9-9928-d0e76153085a', '54b1a5a1-3b4d-44d1-82e5-fe13edefdcd6', 'c492b630-2765-4b36-8a40-7235eb00e2b7', '0212563d-e395-4b32-b02b-f5f542b3996a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:18 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Delete snapshot completed successfully. Jul 08 03:40:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-50fc19fa-a3e7-49ff-b748-33672383c6ea tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-c09eab51-9fbf-407a-a446-485f33595140-delete_snapshot" released by "delete_snapshot" :: held 3.377s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-9e80298f-7339-485a-aebb-de138468862e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-9e80298f-7339-485a-aebb-de138468862e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f22b1c-b52f-40e7-9e90-f4c419542132]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:19 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e Jul 08 03:40:19 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:19 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e" returned: 0 in 0.846s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:19 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e Jul 08 03:40:19 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:20 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9e80298f-7339-485a-aebb-de138468862e" returned: 0 in 0.782s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-quobyte-9e80298f-7339-485a-aebb-de138468862e" released by "delete_volume" :: held 1.702s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Created reservations ['cb333a3e-20f9-4e4e-bcb1-70c33f97b442', '4559bd89-5e6a-4444-90a1-03b1562b1c42', '5dd6de8d-7bd7-4f63-b52e-a6d663b0ddbc', 'c8941f7b-cd93-461b-913f-a20eb089d219'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:20 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:20 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:21 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.837s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:21 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Deleted volume successfully. Jul 08 03:40:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a84ce1c9-6d32-4ea6-9f70-0bd5dc65d565 tempest-VolumesSnapshotListTestJSON-1455346490 None] Lock "cinder-9e80298f-7339-485a-aebb-de138468862e-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Flow 'volume_create_manager' (eb0516e2-582e-4b80-b07c-489e355c6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef957de-d2e1-4137-90ea-22375fbdaa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef957de-d2e1-4137-90ea-22375fbdaa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2086522019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54480263-97b3-4dee-8cce-62a92d854b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2bfd7395d947218e85857677e8b020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:23Z,use_quota=True,user_id='fc286e36cc0d4c5cb058843d4bfb06df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575f7c36-d029-472e-b954-cad3c159188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575f7c36-d029-472e-b954-cad3c159188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bb97d9-d9d8-40b5-a725-dabb812e5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bb97d9-d9d8-40b5-a725-dabb812e5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54480263-97b3-4dee-8cce-62a92d854b2a', 'volume_name': 'volume-54480263-97b3-4dee-8cce-62a92d854b2a', 'volume_size': 2}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013944f7-bc18-45ff-b3b6-6d455ca53e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013944f7-bc18-45ff-b3b6-6d455ca53e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2952b7dd-8c6b-473c-9340-d3d149712d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:23 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Volume 54480263-97b3-4dee-8cce-62a92d854b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54480263-97b3-4dee-8cce-62a92d854b2a', 'volume_size': 2} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2086522019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54480263-97b3-4dee-8cce-62a92d854b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2bfd7395d947218e85857677e8b020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:23Z,use_quota=True,user_id='fc286e36cc0d4c5cb058843d4bfb06df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Creating volume 54480263-97b3-4dee-8cce-62a92d854b2a {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:40:23 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:40:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a 2147483648 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:23 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a 2147483648 Jul 08 03:40:23 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:24 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a 2147483648" returned: 0 in 0.982s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:24 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a Jul 08 03:40:24 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:25 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2952b7dd-8c6b-473c-9340-d3d149712d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54480263-97b3-4dee-8cce-62a92d854b2a', 'volume_size': 2}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb57999-68c9-418a-a37f-3ea854ff1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Volume volume-54480263-97b3-4dee-8cce-62a92d854b2a (54480263-97b3-4dee-8cce-62a92d854b2a): created successfully Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb57999-68c9-418a-a37f-3ea854ff1e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Flow 'volume_create_manager' (eb0516e2-582e-4b80-b07c-489e355c6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-69634f0b-d08d-47b8-8083-f244bf6caa76 tempest-VolumesCloneNegativeTest-1713112204 None] Created volume successfully. Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Acquiring lock "cinder-54480263-97b3-4dee-8cce-62a92d854b2a-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "cinder-54480263-97b3-4dee-8cce-62a92d854b2a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Acquiring lock "cinder-quobyte-54480263-97b3-4dee-8cce-62a92d854b2a" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "cinder-quobyte-54480263-97b3-4dee-8cce-62a92d854b2a" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c8efa6-0859-45cb-b367-d66b67d82ef7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:25 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a Jul 08 03:40:25 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:26 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a" returned: 0 in 0.872s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:26 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a Jul 08 03:40:26 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a23af9-de4f-4830-9635-67c5765469ac]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:26 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 Jul 08 03:40:26 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:27 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-54480263-97b3-4dee-8cce-62a92d854b2a" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "cinder-quobyte-54480263-97b3-4dee-8cce-62a92d854b2a" released by "delete_volume" :: held 1.613s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Created reservations ['3db3d0ab-0cda-4b97-b885-d5f8af1cbcc3', '57a69b25-675f-438c-80fe-69a2e9519a88', '684baf43-b04f-4d06-90b2-bd2b57dd8bcd', 'b83efb62-b57a-495a-b36d-8062920ab1c6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:27 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:27 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:27 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069" returned: 0 in 0.901s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.928s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-1025e868-3392-4b77-b7c9-788fa6443069', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bab9b1c0-9d08-417c-8753-c654a138cbe1', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:40:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-7c0980e5-797b-4e23-bb5d-4868267d01f6 req-912d060f-652b-4c40-8822-a0a0108f7957 tempest-TestServerVolumeAttachmentScenario-1428318492 None] attachment_update completed successfully. Jul 08 03:40:28 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.687s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:28 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Deleted volume successfully. Jul 08 03:40:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f2f1cda3-1759-4b94-843c-771a7857ddc7 tempest-VolumesCloneNegativeTest-1713112204 None] Lock "cinder-54480263-97b3-4dee-8cce-62a92d854b2a-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Flow 'volume_create_manager' (2cfdfc05-9378-4ab4-a002-77b345a451d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2047dce-65d5-4988-8f48-aadf4a823bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2047dce-65d5-4988-8f48-aadf4a823bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-535092592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1be598cc4b34e9889e40a211e10e8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:31Z,use_quota=True,user_id='68e8fd3612324e25ab3a6c54c78ba2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e54d7a1-26ad-470b-ac77-778bae8fcb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e54d7a1-26ad-470b-ac77-778bae8fcb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4593ee5d-d956-49df-ac57-5c1e7f5b4165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4593ee5d-d956-49df-ac57-5c1e7f5b4165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc', 'volume_name': 'volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73236b5e-27fe-4bde-aec1-782af049e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73236b5e-27fe-4bde-aec1-782af049e88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35e4369-1eeb-461d-9803-3b9a60c4612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:31 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Volume 17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc', 'volume_size': 1} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-535092592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1be598cc4b34e9889e40a211e10e8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:31Z,use_quota=True,user_id='68e8fd3612324e25ab3a6c54c78ba2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Creating volume 17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:40:31 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:40:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:31 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc 1073741824 Jul 08 03:40:31 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:32 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc 1073741824" returned: 0 in 0.983s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:32 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc Jul 08 03:40:32 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:33 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc" returned: 0 in 0.674s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35e4369-1eeb-461d-9803-3b9a60c4612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9099cd-eaee-4f57-b0b1-92648a5e59ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:33 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Volume volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc (17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc): created successfully Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9099cd-eaee-4f57-b0b1-92648a5e59ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Flow 'volume_create_manager' (2cfdfc05-9378-4ab4-a002-77b345a451d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8a97d967-25d7-4698-8a1a-abb7f409a8d1 tempest-VolumesListTestJSON-154851322 None] Created volume successfully. Jul 08 03:40:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-a477e604-0563-42ed-85cc-f3b851e41c11 req-944f3ee7-7882-469f-be65-d0dea64e18e0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Terminate volume connection completed successfully. Jul 08 03:40:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-a477e604-0563-42ed-85cc-f3b851e41c11 req-944f3ee7-7882-469f-be65-d0dea64e18e0 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Deleting attachment bab9b1c0-9d08-417c-8753-c654a138cbe1. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Flow 'volume_create_manager' (009699f8-f082-473c-aea8-be5ef5247634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e82859c-dc96-431c-a7b8-ec4ca6910c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e82859c-dc96-431c-a7b8-ec4ca6910c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2030537479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181ad989-3e96-4829-845e-ffdabf861501,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1be598cc4b34e9889e40a211e10e8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:34Z,use_quota=True,user_id='68e8fd3612324e25ab3a6c54c78ba2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bb4c11-7e3b-443c-90a2-ae82155e2fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bb4c11-7e3b-443c-90a2-ae82155e2fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d078f64-78c9-4e62-b24c-b5ea17fbddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d078f64-78c9-4e62-b24c-b5ea17fbddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181ad989-3e96-4829-845e-ffdabf861501', 'volume_name': 'volume-181ad989-3e96-4829-845e-ffdabf861501', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9e0ca9-a64f-4a2b-87fa-567b236cb7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9e0ca9-a64f-4a2b-87fa-567b236cb7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a0abed-ff81-4e83-9019-97e2decc9a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Volume 181ad989-3e96-4829-845e-ffdabf861501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181ad989-3e96-4829-845e-ffdabf861501', 'volume_size': 1} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2030537479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181ad989-3e96-4829-845e-ffdabf861501,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1be598cc4b34e9889e40a211e10e8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:34Z,use_quota=True,user_id='68e8fd3612324e25ab3a6c54c78ba2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Creating volume 181ad989-3e96-4829-845e-ffdabf861501 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:40:34 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:40:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:34 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 1073741824 Jul 08 03:40:34 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:35 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 1073741824" returned: 0 in 0.911s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:35 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 Jul 08 03:40:35 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:36 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501" returned: 0 in 0.845s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a0abed-ff81-4e83-9019-97e2decc9a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181ad989-3e96-4829-845e-ffdabf861501', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4403e0ae-5ac0-41c9-9eb8-25ed3aa55a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Volume volume-181ad989-3e96-4829-845e-ffdabf861501 (181ad989-3e96-4829-845e-ffdabf861501): created successfully Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4403e0ae-5ac0-41c9-9eb8-25ed3aa55a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Flow 'volume_create_manager' (009699f8-f082-473c-aea8-be5ef5247634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:36 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9d5af663-5415-420d-9225-419ae8791d48 tempest-VolumesListTestJSON-154851322 None] Created volume successfully. Jul 08 03:40:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-09dd6b29-5edf-4101-9127-cecd06ed8b87 req-bba9c24d-85e2-48dc-aada-88ed4cd40daf tempest-TestServerVolumeAttachmentScenario-1428318492 None] Terminate volume connection completed successfully. Jul 08 03:40:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-09dd6b29-5edf-4101-9127-cecd06ed8b87 req-bba9c24d-85e2-48dc-aada-88ed4cd40daf tempest-TestServerVolumeAttachmentScenario-1428318492 None] Deleting attachment 384682c6-2490-482b-b3de-553f4e8ba60d. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Flow 'volume_create_manager' (f3ff38d8-503d-4aac-8ac2-889f647f3822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed15e24-0512-47d5-baca-64b8f7dde610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed15e24-0512-47d5-baca-64b8f7dde610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-485233976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d09d34e-caea-485e-aac5-7e7f90fa0f6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1be598cc4b34e9889e40a211e10e8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:38Z,use_quota=True,user_id='68e8fd3612324e25ab3a6c54c78ba2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e45bc7c-248c-414d-817c-fa3df04838ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e45bc7c-248c-414d-817c-fa3df04838ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63951574-8056-4c3b-92e8-b15ab08386ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63951574-8056-4c3b-92e8-b15ab08386ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d09d34e-caea-485e-aac5-7e7f90fa0f6f', 'volume_name': 'volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30280c1-f634-4c2d-a1f9-86dd049d11b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30280c1-f634-4c2d-a1f9-86dd049d11b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128b7736-3efd-4662-bd56-bfa7d4f603b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Volume 3d09d34e-caea-485e-aac5-7e7f90fa0f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f', 'volume_size': 1} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-485233976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d09d34e-caea-485e-aac5-7e7f90fa0f6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1be598cc4b34e9889e40a211e10e8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:38Z,use_quota=True,user_id='68e8fd3612324e25ab3a6c54c78ba2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Creating volume 3d09d34e-caea-485e-aac5-7e7f90fa0f6f {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:40:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:38 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f 1073741824 Jul 08 03:40:38 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:38 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f 1073741824" returned: 0 in 0.866s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:39 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f Jul 08 03:40:39 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:39 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f" returned: 0 in 0.882s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128b7736-3efd-4662-bd56-bfa7d4f603b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be81df5b-b291-4f76-ac7b-99c1ce5f1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Volume volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f (3d09d34e-caea-485e-aac5-7e7f90fa0f6f): created successfully Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be81df5b-b291-4f76-ac7b-99c1ce5f1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Flow 'volume_create_manager' (f3ff38d8-503d-4aac-8ac2-889f647f3822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-908e0341-5884-4781-9655-d888889581be tempest-VolumesListTestJSON-154851322 None] Created volume successfully. Jul 08 03:40:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "cinder-3d09d34e-caea-485e-aac5-7e7f90fa0f6f-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Lock "cinder-3d09d34e-caea-485e-aac5-7e7f90fa0f6f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "cinder-quobyte-3d09d34e-caea-485e-aac5-7e7f90fa0f6f" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Lock "cinder-quobyte-3d09d34e-caea-485e-aac5-7e7f90fa0f6f" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:42 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a275b7f7-107b-46fb-83b1-ab40fd5d2f7c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:42 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f Jul 08 03:40:42 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:43 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f" returned: 0 in 0.911s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:43 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f Jul 08 03:40:43 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:44 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-3d09d34e-caea-485e-aac5-7e7f90fa0f6f" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Lock "cinder-quobyte-3d09d34e-caea-485e-aac5-7e7f90fa0f6f" released by "delete_volume" :: held 1.601s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Created reservations ['89c606c3-1b10-46eb-a423-dcff42a4e68a', 'e3740aa9-fc9d-4881-80b5-5e98468ebacc', 'c8888fb2-e624-426c-9036-52cbc05c12b9', '67054168-f1b2-4641-9eb0-0ee1f89173cd'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:44 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:44 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Acquiring lock "cinder-181ad989-3e96-4829-845e-ffdabf861501-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Lock "cinder-181ad989-3e96-4829-845e-ffdabf861501-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Acquiring lock "cinder-quobyte-181ad989-3e96-4829-845e-ffdabf861501" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Lock "cinder-quobyte-181ad989-3e96-4829-845e-ffdabf861501" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd742f45-3002-4a04-ab90-b3e484c3f3ea]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:45 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 Jul 08 03:40:45 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:45 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.868s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Deleted volume successfully. Jul 08 03:40:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-30ab91b8-6673-4133-af85-ac710f6dd320 tempest-VolumesListTestJSON-154851322 None] Lock "cinder-3d09d34e-caea-485e-aac5-7e7f90fa0f6f-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:46 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501" returned: 0 in 0.800s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:46 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501 Jul 08 03:40:46 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:46 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-181ad989-3e96-4829-845e-ffdabf861501" returned: 0 in 0.685s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Lock "cinder-quobyte-181ad989-3e96-4829-845e-ffdabf861501" released by "delete_volume" :: held 1.541s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Created reservations ['e54abeb6-a8af-4186-bb6b-925b559c063a', 'c94c9139-5d10-4533-92c5-30a1f6f21b72', 'c7cedb25-bb6c-48d2-b192-7eff948b3ed2', '694d6024-3ea5-41ee-87e3-a95a13f100bb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:46 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:46 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:47 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:47 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Acquiring lock "cinder-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Lock "cinder-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Acquiring lock "cinder-quobyte-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Lock "cinder-quobyte-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:47 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.891s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Deleted volume successfully. Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8421cba0-d32f-41c3-8329-f01728cb6b57]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7f438e60-a9ae-400b-946f-3748efce5dec tempest-VolumesListTestJSON-154851322 None] Lock "cinder-181ad989-3e96-4829-845e-ffdabf861501-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:47 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.829s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:40:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:40:47 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc Jul 08 03:40:47 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "cinder-1025e868-3392-4b77-b7c9-788fa6443069-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-1025e868-3392-4b77-b7c9-788fa6443069-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "cinder-quobyte-1025e868-3392-4b77-b7c9-788fa6443069" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-quobyte-1025e868-3392-4b77-b7c9-788fa6443069" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[619508c5-b328-45b4-a1f8-ae67cdbbcd98]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:48 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 Jul 08 03:40:48 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:48 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc" returned: 0 in 0.926s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:48 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc Jul 08 03:40:48 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Flow 'volume_create_manager' (464015aa-4ccd-46c0-aa9b-723672f0d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a4d953-cf36-43b7-8f1b-77fb634e90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a4d953-cf36-43b7-8f1b-77fb634e90e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-727577100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd093428-1cbc-4846-b6e2-8d5fdd4958e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2f92a6e0324dd0b1ab2c85b1670cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:49Z,use_quota=True,user_id='2147e6fde28543d7bc97a29fce811b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2d0b2c-f4ce-4b65-907d-151070e32b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2d0b2c-f4ce-4b65-907d-151070e32b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f13e9e-d566-4e2a-b490-f045f457754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f13e9e-d566-4e2a-b490-f045f457754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd093428-1cbc-4846-b6e2-8d5fdd4958e3', 'volume_name': 'volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96594995-88af-451a-bec2-db02f01505ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96594995-88af-451a-bec2-db02f01505ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a93acd9-a991-413b-8a6e-9bf96ede2366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:49 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Volume bd093428-1cbc-4846-b6e2-8d5fdd4958e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3', 'volume_size': 1} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-727577100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd093428-1cbc-4846-b6e2-8d5fdd4958e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2f92a6e0324dd0b1ab2c85b1670cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:49Z,use_quota=True,user_id='2147e6fde28543d7bc97a29fce811b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Creating volume bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:40:49 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:49 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 1073741824 Jul 08 03:40:49 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:49 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069" returned: 0 in 0.915s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:49 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069 Jul 08 03:40:49 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:49 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc" returned: 0 in 0.806s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Lock "cinder-quobyte-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc" released by "delete_volume" :: held 1.805s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Created reservations ['86017f78-fd4c-4aaf-8679-fd92ce7c91f7', '3f920c8c-228e-4134-b152-d0dea1457989', '68edf5c0-7245-44a3-8dc4-f6e5f85c8911', 'b7da76e2-6670-4bb4-a7b8-cede77af37b6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:49 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:49 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:50 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1025e868-3392-4b77-b7c9-788fa6443069" returned: 0 in 0.851s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-quobyte-1025e868-3392-4b77-b7c9-788fa6443069" released by "delete_volume" :: held 1.826s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:50 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 1073741824" returned: 0 in 1.135s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=79,cinder:UPDATE=82,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=73,cinder:UPDATE=85,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:40:50 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:40:50 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Created reservations ['159e0fb9-9635-4fa8-afce-f7e30913a31e', '7aac8f17-312a-4320-b9b4-01f58fceec4a', 'ef691bf1-a77e-43b5-b5a1-98a16d7de085', '4f305dd2-99b8-40d1-b457-09b8579f0647'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "cinder-edd1ce09-5dec-4d80-b762-465d9a9ef06d-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:50 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:50 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-edd1ce09-5dec-4d80-b762-465d9a9ef06d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "cinder-quobyte-edd1ce09-5dec-4d80-b762-465d9a9ef06d" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-quobyte-edd1ce09-5dec-4d80-b762-465d9a9ef06d" acquired by "delete_volume" :: waited 0.037s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[372a4e04-47cc-4e06-90eb-ad1adc807c88]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:40:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:51 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d Jul 08 03:40:51 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:51 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.410s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Deleted volume successfully. Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3b0281d4-9bf5-403f-b00b-7c027a71270e tempest-VolumesListTestJSON-154851322 None] Lock "cinder-17e4f4b7-a40a-4ef3-9584-0bff26c3c6dc-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:51 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 1.292s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.504s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a93acd9-a991-413b-8a6e-9bf96ede2366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:51 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914393bd-7c82-4b75-b087-c18a24240fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.041s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Deleted volume successfully. Jul 08 03:40:51 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Volume volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 (bd093428-1cbc-4846-b6e2-8d5fdd4958e3): created successfully Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914393bd-7c82-4b75-b087-c18a24240fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Flow 'volume_create_manager' (464015aa-4ccd-46c0-aa9b-723672f0d100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c82f2747-937a-4cf4-b13f-0070c0b6baba tempest-TestStampPattern-1482223669 None] Created volume successfully. Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-97994503-4089-46ef-8046-938a9195fde2 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-1025e868-3392-4b77-b7c9-788fa6443069-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:51 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d" returned: 0 in 1.077s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:51 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d Jul 08 03:40:51 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:52 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd1ce09-5dec-4d80-b762-465d9a9ef06d" returned: 0 in 0.668s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-quobyte-edd1ce09-5dec-4d80-b762-465d9a9ef06d" released by "delete_volume" :: held 1.811s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Created reservations ['b1b86a17-ff2f-432a-88c6-f40520fdb230', '648be0e2-3446-4698-8d22-ae3b4fd1fe64', 'f0dd4bca-c08e-4e0f-95bd-d4cadff9945b', '777cdaca-daf9-45dc-a014-25d3f079b011'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:52 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:40:52 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:53 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.710s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:53 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:40:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Deleted volume successfully. Jul 08 03:40:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c823fb46-2065-4c48-9a6f-87c2c2009340 tempest-TestServerVolumeAttachmentScenario-1428318492 None] Lock "cinder-edd1ce09-5dec-4d80-b762-465d9a9ef06d-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Flow 'volume_create_manager' (8b13c3f1-b164-4fd3-8f0b-ba27c0215b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5fa271-a8cc-4e43-b738-7df8ff045743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5fa271-a8cc-4e43-b738-7df8ff045743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1216168314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafe8ac8-ea62-40a2-8201-58243afb0731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709a3bca2b7442faae3453b6112c504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:54Z,use_quota=True,user_id='fa63a4e62e8b4458957f6542d81724c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b699e0b-8d02-49a4-a5fe-21519d56d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b699e0b-8d02-49a4-a5fe-21519d56d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9430631d-ea6d-4ea7-a042-b352ad6726de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9430631d-ea6d-4ea7-a042-b352ad6726de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eafe8ac8-ea62-40a2-8201-58243afb0731', 'volume_name': 'volume-eafe8ac8-ea62-40a2-8201-58243afb0731', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1873144-f2b8-445b-981f-5463b57fa456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1873144-f2b8-445b-981f-5463b57fa456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243e9b8f-ad3d-46b9-b407-97be3648d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:54 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Volume eafe8ac8-ea62-40a2-8201-58243afb0731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eafe8ac8-ea62-40a2-8201-58243afb0731', 'volume_size': 1} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1216168314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafe8ac8-ea62-40a2-8201-58243afb0731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709a3bca2b7442faae3453b6112c504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:40:54Z,use_quota=True,user_id='fa63a4e62e8b4458957f6542d81724c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Creating volume eafe8ac8-ea62-40a2-8201-58243afb0731 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:40:54 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:54 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 1073741824 Jul 08 03:40:54 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:54 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 1073741824" returned: 0 in 0.870s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:40:55 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 Jul 08 03:40:55 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:40:55 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731" returned: 0 in 0.704s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (243e9b8f-ad3d-46b9-b407-97be3648d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafe8ac8-ea62-40a2-8201-58243afb0731', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffd2ff5-72e1-48ec-bbdf-93935c2c4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:40:55 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Volume volume-eafe8ac8-ea62-40a2-8201-58243afb0731 (eafe8ac8-ea62-40a2-8201-58243afb0731): created successfully Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffd2ff5-72e1-48ec-bbdf-93935c2c4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:40:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Flow 'volume_create_manager' (8b13c3f1-b164-4fd3-8f0b-ba27c0215b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:40:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fd36c7aa-c14e-4f76-92a4-00255fb9379a tempest-VolumesNegativeTest-140117972 None] Created volume successfully. Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (1d7d5314-b4ed-43fe-81ed-cd5b8cc87b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ed1f7b-65b7-4418-ba2a-e5c70101e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ed1f7b-65b7-4418-ba2a-e5c70101e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482485741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25699dcf-786f-4a90-b767-c483b08af767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:05Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc112349-51c1-4c22-be24-5a98d8fc744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc112349-51c1-4c22-be24-5a98d8fc744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8301124-b8a8-46b0-81be-473362bd7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8301124-b8a8-46b0-81be-473362bd7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25699dcf-786f-4a90-b767-c483b08af767', 'volume_name': 'volume-25699dcf-786f-4a90-b767-c483b08af767', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed704546-5bb9-4ce2-acf5-75a03900b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed704546-5bb9-4ce2-acf5-75a03900b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d39760-dbc5-4089-afa8-0f9531b25d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:04 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Volume 25699dcf-786f-4a90-b767-c483b08af767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25699dcf-786f-4a90-b767-c483b08af767', 'volume_size': 1} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482485741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25699dcf-786f-4a90-b767-c483b08af767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:05Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Creating volume 25699dcf-786f-4a90-b767-c483b08af767 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:04 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:04 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 1073741824 Jul 08 03:41:04 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (1a59a84b-166d-4914-acd5-51315dce4094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a82d99f-3a30-4d97-b23c-835572a657e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a82d99f-3a30-4d97-b23c-835572a657e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560071887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f14ac4-0904-4b52-b93e-b42d56edbab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:05Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1cd4f1-5076-4f2b-82c9-c9d1509b1ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1cd4f1-5076-4f2b-82c9-c9d1509b1ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39051359-5fef-4c14-992e-905fee184d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39051359-5fef-4c14-992e-905fee184d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f14ac4-0904-4b52-b93e-b42d56edbab2', 'volume_name': 'volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdf0f2a-b716-4a43-9c8e-f18a861282d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdf0f2a-b716-4a43-9c8e-f18a861282d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03666219-3fe3-443d-8cda-0300af5e9548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:05 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Volume c8f14ac4-0904-4b52-b93e-b42d56edbab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2', 'volume_size': 1} Jul 08 03:41:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (5d73c9cf-56a0-4463-9d6a-cf663d4904c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e954ba68-5d8a-4c16-be7e-cd1a94576567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e954ba68-5d8a-4c16-be7e-cd1a94576567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271230122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e435d881-36de-44e8-bad7-731104f02fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:06Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5e8ae4-cf9f-428f-aa20-8de16b5bc73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5e8ae4-cf9f-428f-aa20-8de16b5bc73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c04c65e-567b-4c17-895d-6fc7eb29e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c04c65e-567b-4c17-895d-6fc7eb29e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e435d881-36de-44e8-bad7-731104f02fd2', 'volume_name': 'volume-e435d881-36de-44e8-bad7-731104f02fd2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa08aa-0177-4704-a25e-05193d4c42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa08aa-0177-4704-a25e-05193d4c42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a83e03-e7c0-4deb-b7d6-44b6cfd21d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Volume e435d881-36de-44e8-bad7-731104f02fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e435d881-36de-44e8-bad7-731104f02fd2', 'volume_size': 1} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:06 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 1073741824" returned: 0 in 1.880s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:06 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 Jul 08 03:41:06 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (9a9789c9-c5de-4412-ae16-5de6881e45b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376f6a27-2460-43b9-b966-d4c0c06e079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376f6a27-2460-43b9-b966-d4c0c06e079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279344057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3d5287-f076-43bf-8a35-10f5f0239d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:07Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ad2a94-9960-4aec-8ee6-9fad32e47129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ad2a94-9960-4aec-8ee6-9fad32e47129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a87ccae-9347-41b2-88b4-fc2896f5cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a87ccae-9347-41b2-88b4-fc2896f5cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3d5287-f076-43bf-8a35-10f5f0239d2e', 'volume_name': 'volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa2a877-18cf-4a0f-aaa5-5e618da6d421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa2a877-18cf-4a0f-aaa5-5e618da6d421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562da12e-a408-40b4-bed1-944803d01edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Volume 4d3d5287-f076-43bf-8a35-10f5f0239d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e', 'volume_size': 1} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (8c77518c-7789-4dba-9de4-402a000e8d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1088c69-e528-4359-b1ec-347921fa52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1088c69-e528-4359-b1ec-347921fa52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1081454154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709088a6-9497-4af1-8d10-5029ae92a727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:08Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ce3e36-5d9d-4190-8ec8-39432ee4d2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ce3e36-5d9d-4190-8ec8-39432ee4d2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c2b27d-aecd-4bd8-9a3e-d6b50d1dbff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c2b27d-aecd-4bd8-9a3e-d6b50d1dbff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709088a6-9497-4af1-8d10-5029ae92a727', 'volume_name': 'volume-709088a6-9497-4af1-8d10-5029ae92a727', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407c1287-bdfd-4ea6-be9a-f40396f55241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407c1287-bdfd-4ea6-be9a-f40396f55241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded5dbcb-ece2-4269-b273-58d98a28cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Volume 709088a6-9497-4af1-8d10-5029ae92a727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709088a6-9497-4af1-8d10-5029ae92a727', 'volume_size': 1} Jul 08 03:41:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:08 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767" returned: 0 in 1.222s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] <== create_volume: return (3174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.176s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560071887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f14ac4-0904-4b52-b93e-b42d56edbab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:05Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Creating volume c8f14ac4-0904-4b52-b93e-b42d56edbab2 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:08 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d39760-dbc5-4089-afa8-0f9531b25d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25699dcf-786f-4a90-b767-c483b08af767', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:08 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 1073741824 Jul 08 03:41:08 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ff2c2-2ee9-4198-aad2-fa7d957c4af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:08 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Volume volume-25699dcf-786f-4a90-b767-c483b08af767 (25699dcf-786f-4a90-b767-c483b08af767): created successfully Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ff2c2-2ee9-4198-aad2-fa7d957c4af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (1d7d5314-b4ed-43fe-81ed-cd5b8cc87b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0e2bf0f9-2aa0-4964-be20-1cfd60356aec tempest-CreateVolumesFromImageTest-1146646673 None] Created volume successfully. Jul 08 03:41:09 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 1073741824" returned: 0 in 1.219s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:09 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 Jul 08 03:41:09 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:10 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2" returned: 0 in 0.924s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.054s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271230122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e435d881-36de-44e8-bad7-731104f02fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:06Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Creating volume e435d881-36de-44e8-bad7-731104f02fd2 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:10 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03666219-3fe3-443d-8cda-0300af5e9548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:10 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 1073741824 Jul 08 03:41:10 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39630633-7328-4123-8e96-ce0a8773730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:10 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Volume volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 (c8f14ac4-0904-4b52-b93e-b42d56edbab2): created successfully Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39630633-7328-4123-8e96-ce0a8773730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (1a59a84b-166d-4914-acd5-51315dce4094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:10 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b74ebfa4-1079-4ad7-94fb-fa3e13f40605 tempest-CreateVolumesFromImageTest-1146646673 None] Created volume successfully. Jul 08 03:41:11 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 1073741824" returned: 0 in 1.008s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:11 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 Jul 08 03:41:11 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:12 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2" returned: 0 in 0.753s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.097s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279344057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3d5287-f076-43bf-8a35-10f5f0239d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:07Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Creating volume 4d3d5287-f076-43bf-8a35-10f5f0239d2e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:12 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a83e03-e7c0-4deb-b7d6-44b6cfd21d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e435d881-36de-44e8-bad7-731104f02fd2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:12 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e 1073741824 Jul 08 03:41:12 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7797673f-e1ba-43be-b403-11bdea7a93a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:12 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Volume volume-e435d881-36de-44e8-bad7-731104f02fd2 (e435d881-36de-44e8-bad7-731104f02fd2): created successfully Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7797673f-e1ba-43be-b403-11bdea7a93a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:12 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (5d73c9cf-56a0-4463-9d6a-cf663d4904c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c166ced5-6c92-4734-90ff-2a66000debce tempest-CreateVolumesFromImageTest-1146646673 None] Created volume successfully. Jul 08 03:41:13 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e 1073741824" returned: 0 in 0.946s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:13 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e Jul 08 03:41:13 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:14 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e" returned: 0 in 1.128s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1081454154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709088a6-9497-4af1-8d10-5029ae92a727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac489e05fe74ad2aeaa17f2d34243ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:08Z,use_quota=True,user_id='c406deb2c717414eb69f81264988022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Creating volume 709088a6-9497-4af1-8d10-5029ae92a727 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:14 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562da12e-a408-40b4-bed1-944803d01edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c536ddb-3752-4b47-ac19-8a3027f680a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:14 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Volume volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e (4d3d5287-f076-43bf-8a35-10f5f0239d2e): created successfully Jul 08 03:41:14 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 1073741824 Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c536ddb-3752-4b47-ac19-8a3027f680a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:14 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (9a9789c9-c5de-4412-ae16-5de6881e45b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3f796fc7-c874-4fe8-abbf-8be704e103bb tempest-CreateVolumesFromImageTest-1146646673 None] Created volume successfully. Jul 08 03:41:15 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 1073741824" returned: 0 in 1.051s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:15 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 Jul 08 03:41:15 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:16 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727" returned: 0 in 0.701s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded5dbcb-ece2-4269-b273-58d98a28cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709088a6-9497-4af1-8d10-5029ae92a727', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d102663e-d6f3-4eb8-9a87-697ac48ba66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Volume volume-709088a6-9497-4af1-8d10-5029ae92a727 (709088a6-9497-4af1-8d10-5029ae92a727): created successfully Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d102663e-d6f3-4eb8-9a87-697ac48ba66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Flow 'volume_create_manager' (8c77518c-7789-4dba-9de4-402a000e8d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e8952320-9f30-40a4-8242-4c23f8bdfac4 tempest-CreateVolumesFromImageTest-1146646673 None] Created volume successfully. Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-709088a6-9497-4af1-8d10-5029ae92a727-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-709088a6-9497-4af1-8d10-5029ae92a727-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-quobyte-709088a6-9497-4af1-8d10-5029ae92a727" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-709088a6-9497-4af1-8d10-5029ae92a727" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c860d5c-607b-4725-850d-c74681444c37]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:16 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 Jul 08 03:41:16 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:17 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727" returned: 0 in 0.971s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:17 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727 Jul 08 03:41:17 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:18 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-709088a6-9497-4af1-8d10-5029ae92a727" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-709088a6-9497-4af1-8d10-5029ae92a727" released by "delete_volume" :: held 1.689s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Created reservations ['aaa3b341-284b-48b8-b6b8-2afdc853fc05', '00999214-eef3-4fe5-86af-a8e90da09670', 'f1eb1c3a-8447-49e9-9dbb-17a252ae6130', '57ab3e96-8728-45d0-a3de-cd502bb84146'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:18 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:18 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-4d3d5287-f076-43bf-8a35-10f5f0239d2e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-4d3d5287-f076-43bf-8a35-10f5f0239d2e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-quobyte-4d3d5287-f076-43bf-8a35-10f5f0239d2e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-4d3d5287-f076-43bf-8a35-10f5f0239d2e" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8426f6-81ca-462f-9920-4a1f07d4c4b8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:19 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e Jul 08 03:41:19 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:19 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.762s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:19 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Deleted volume successfully. Jul 08 03:41:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-300b360c-924e-4c32-a926-a1581f255534 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-709088a6-9497-4af1-8d10-5029ae92a727-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:19 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:19 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e Jul 08 03:41:19 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:20 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4d3d5287-f076-43bf-8a35-10f5f0239d2e" returned: 0 in 0.667s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-4d3d5287-f076-43bf-8a35-10f5f0239d2e" released by "delete_volume" :: held 1.533s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Created reservations ['d1ec6b47-a405-435a-908e-600d303c4fc7', '0ad4fe2f-d42b-4263-ba11-a5879784e89c', '898813fb-f5a6-4542-b7fc-4ff503da5621', '3068a23d-d886-4864-9df8-b0c55258d455'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:20 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:20 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-e435d881-36de-44e8-bad7-731104f02fd2-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-e435d881-36de-44e8-bad7-731104f02fd2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-quobyte-e435d881-36de-44e8-bad7-731104f02fd2" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-e435d881-36de-44e8-bad7-731104f02fd2" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee8d1d-58a1-420d-a8bf-eb3aa3699aae]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:21 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:21 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 Jul 08 03:41:21 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Deleted volume successfully. Jul 08 03:41:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fb41889-4350-48cb-b42a-2b7403ee1070 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-4d3d5287-f076-43bf-8a35-10f5f0239d2e-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:22 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2" returned: 0 in 0.798s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:22 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2 Jul 08 03:41:22 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:22 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e435d881-36de-44e8-bad7-731104f02fd2" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-e435d881-36de-44e8-bad7-731104f02fd2" released by "delete_volume" :: held 1.533s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Created reservations ['2de071dd-425d-4dd5-b53e-1e8d5eb4d7ec', 'f56e8e9a-b47a-4b58-af40-ab958651b2eb', '2a62572a-c1cc-463a-86ca-dd35305c20b6', 'ee4831bd-cfb2-479e-886c-504c104a1066'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:22 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:22 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:23 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:23 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Deleted volume successfully. Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-85aab5cc-30c6-4bce-ad0b-04c130d5fd27 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-e435d881-36de-44e8-bad7-731104f02fd2-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-c8f14ac4-0904-4b52-b93e-b42d56edbab2-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-c8f14ac4-0904-4b52-b93e-b42d56edbab2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-quobyte-c8f14ac4-0904-4b52-b93e-b42d56edbab2" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-c8f14ac4-0904-4b52-b93e-b42d56edbab2" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d73684b-2116-4b64-990c-ea1f94de2236]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:23 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 Jul 08 03:41:23 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:24 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:24 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2 Jul 08 03:41:24 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:25 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c8f14ac4-0904-4b52-b93e-b42d56edbab2" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-c8f14ac4-0904-4b52-b93e-b42d56edbab2" released by "delete_volume" :: held 1.509s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Created reservations ['053dff19-586b-45e5-8efb-57791513c94e', '5ad5785a-500e-488f-a20c-6990c27a8a39', 'a82be533-223d-456a-9a71-b8714010efdb', '1603090b-efbb-4a70-ba8b-921d8fa9676c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:25 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:25 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-25699dcf-786f-4a90-b767-c483b08af767-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-25699dcf-786f-4a90-b767-c483b08af767-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "cinder-quobyte-25699dcf-786f-4a90-b767-c483b08af767" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-25699dcf-786f-4a90-b767-c483b08af767" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e758e0-5024-4832-92e5-963d0e3c8c1d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:25 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.689s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:25 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Deleted volume successfully. Jul 08 03:41:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f604b14b-3498-4f1d-9b31-45ad9442516f tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-c8f14ac4-0904-4b52-b93e-b42d56edbab2-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:26 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 Jul 08 03:41:26 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:26 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767" returned: 0 in 0.782s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:26 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767 Jul 08 03:41:26 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:27 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25699dcf-786f-4a90-b767-c483b08af767" returned: 0 in 0.680s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-quobyte-25699dcf-786f-4a90-b767-c483b08af767" released by "delete_volume" :: held 1.521s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Created reservations ['a8e28899-afb1-4572-aff6-4323eca0c92b', '255a03cc-fb46-4a00-99c1-a37d6deb0822', 'e87127ed-17fc-400e-a1db-348ca4dd6a01', 'caa18bf9-c2cf-4c7d-b527-da7dda39d513'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:27 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:27 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:28 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.662s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:28 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Deleted volume successfully. Jul 08 03:41:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e115d393-693c-4614-b6f5-694e53617213 tempest-CreateVolumesFromImageTest-1146646673 None] Lock "cinder-25699dcf-786f-4a90-b767-c483b08af767-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Acquiring lock "cinder-eafe8ac8-ea62-40a2-8201-58243afb0731-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Lock "cinder-eafe8ac8-ea62-40a2-8201-58243afb0731-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Acquiring lock "cinder-quobyte-eafe8ac8-ea62-40a2-8201-58243afb0731" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:41:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Lock "cinder-quobyte-eafe8ac8-ea62-40a2-8201-58243afb0731" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:41:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed0da96-6a97-4be5-99a4-c32859c2e12b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:32 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 Jul 08 03:41:32 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:33 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731" returned: 0 in 0.786s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:33 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731 Jul 08 03:41:33 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:33 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eafe8ac8-ea62-40a2-8201-58243afb0731" returned: 0 in 0.691s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Lock "cinder-quobyte-eafe8ac8-ea62-40a2-8201-58243afb0731" released by "delete_volume" :: held 1.532s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:33 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Created reservations ['6c822e8a-a11a-45e1-aa13-50e383e34cc4', 'e722f30f-664e-4012-8a9c-fabd9c1a09b7', '5ecf1bbc-f652-4625-bf90-7cb16dadef2a', '503bda71-050b-40c3-bac4-c5db373ea9b6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:34 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:34 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8740f7-74d4-4ef8-942a-0ef95de2c5e9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:34 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.749s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Deleted volume successfully. Jul 08 03:41:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48f707d4-18be-491f-a048-3013d3da8248 tempest-VolumesNegativeTest-140117972 None] Lock "cinder-eafe8ac8-ea62-40a2-8201-58243afb0731-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:41:34 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:41:34 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:35 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 1.043s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b047fd6f-a7c3-4b6a-934e-582db7c42ca8', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:41:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-4f76ef32-45d8-4363-a563-ca2ea2f7f207 req-b37411e5-903b-48bf-ac41-a2b9ef02055b tempest-TestStampPattern-1482223669 None] attachment_update completed successfully. Jul 08 03:41:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-d0aee615-6ca8-4129-9420-16748bd68e88 req-14d5a266-7b38-4846-9604-89c6c6efd985 tempest-TestStampPattern-1482223669 None] Terminate volume connection completed successfully. Jul 08 03:41:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-d0aee615-6ca8-4129-9420-16748bd68e88 req-14d5a266-7b38-4846-9604-89c6c6efd985 tempest-TestStampPattern-1482223669 None] Deleting attachment b047fd6f-a7c3-4b6a-934e-582db7c42ca8. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:41:45 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:INSERT=24,cinder:UPDATE=80,cinder:SELECT=57,cinder:DELETE=4 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:47 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:41:47 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:47 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.877s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Creating offline snapshot 1f223b95-789e-47ef-90ec-75eef19928e3 of volume bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1ad683-4909-417d-a4bb-e9b7a000d00f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:48 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:41:48 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:48 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 0.961s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:48 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 1G Jul 08 03:41:48 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:49 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 1G" returned: 0 in 0.965s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:49 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 Jul 08 03:41:49 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:50 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3" returned: 0 in 0.762s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:50 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 is being set with open permissions: ugo+rw Jul 08 03:41:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:50 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 Jul 08 03:41:50 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:51 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3" returned: 0 in 0.788s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:51 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=89,cinder:SELECT=55,cinder:DELETE=12,cinder:INSERT=14 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:41:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:51 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info Jul 08 03:41:51 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (6c3cf51f-abd9-47e6-8bf7-5bb80c2f16c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e70b9a-7962-4714-b910-7685c6e6f9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e70b9a-7962-4714-b910-7685c6e6f9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2107965328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ac5460-0486-4560-be30-9baeadae0a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:52Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e65af0-47b0-4a2f-8554-db7ba43c6cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e65af0-47b0-4a2f-8554-db7ba43c6cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf2ed4b-cb56-40fc-9999-d1bed5ec0337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf2ed4b-cb56-40fc-9999-d1bed5ec0337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ac5460-0486-4560-be30-9baeadae0a8e', 'volume_name': 'volume-f4ac5460-0486-4560-be30-9baeadae0a8e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be58bd7-d8d9-4b3a-a371-67775ce93aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be58bd7-d8d9-4b3a-a371-67775ce93aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8310f2a-94d1-45f9-a9ce-eca22acb7115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Volume f4ac5460-0486-4560-be30-9baeadae0a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ac5460-0486-4560-be30-9baeadae0a8e', 'volume_size': 1} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:52 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info" returned: 0 in 0.769s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:52 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info is being set with open permissions: ugo+rw Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:52 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info Jul 08 03:41:52 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:52 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.info" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.049s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2107965328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ac5460-0486-4560-be30-9baeadae0a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:52Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Creating volume f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:53 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:53 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e 1073741824 Jul 08 03:41:53 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8f219ba9-dc8b-436a-8c55-5103dcf9a2a3 tempest-TestStampPattern-1482223669 None] Create snapshot completed successfully Jul 08 03:41:54 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e 1073741824" returned: 0 in 1.149s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:54 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e Jul 08 03:41:54 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Flow 'volume_create_manager' (81e0738c-204a-45e4-88ed-95e7dda0abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea08495-e560-4e8d-a25b-c16c90029a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea08495-e560-4e8d-a25b-c16c90029a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-793322014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a5bf89-61e1-4b38-9388-9378be6036c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2462b148f9d047e6a3acde791efcfbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:55Z,use_quota=True,user_id='ff2e85d117334ca782d75e80db4b09b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44c5762-9522-4f6f-9b3e-b113d04f2bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44c5762-9522-4f6f-9b3e-b113d04f2bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cebe579-bf38-4e82-b3bf-d8c5b9856996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cebe579-bf38-4e82-b3bf-d8c5b9856996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a5bf89-61e1-4b38-9388-9378be6036c7', 'volume_name': 'volume-91a5bf89-61e1-4b38-9388-9378be6036c7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a6a415-dadb-4827-8e76-824bb2784c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:54 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a6a415-dadb-4827-8e76-824bb2784c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3998e930-408b-49b8-95ac-47506c48b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:54 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Volume 91a5bf89-61e1-4b38-9388-9378be6036c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a5bf89-61e1-4b38-9388-9378be6036c7', 'volume_size': 1} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e" returned: 0 in 0.698s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-793322014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a5bf89-61e1-4b38-9388-9378be6036c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2462b148f9d047e6a3acde791efcfbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:41:55Z,use_quota=True,user_id='ff2e85d117334ca782d75e80db4b09b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Creating volume 91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:41:54 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:54 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 1073741824 Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8310f2a-94d1-45f9-a9ce-eca22acb7115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ac5460-0486-4560-be30-9baeadae0a8e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:54 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5d84db-c702-4932-bce2-bb74e8b42529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:54 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Volume volume-f4ac5460-0486-4560-be30-9baeadae0a8e (f4ac5460-0486-4560-be30-9baeadae0a8e): created successfully Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5d84db-c702-4932-bce2-bb74e8b42529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (6c3cf51f-abd9-47e6-8bf7-5bb80c2f16c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5c0e0bbd-10b9-42c8-bcec-1abf09a9bc82 tempest-VolumesSnapshotTestJSON-544264329 None] Created volume successfully. Jul 08 03:41:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:55 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 1073741824" returned: 0 in 0.870s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:55 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:41:55 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:56 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.854s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3998e930-408b-49b8-95ac-47506c48b6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a5bf89-61e1-4b38-9388-9378be6036c7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be31dfc-edfa-4b2c-a0b5-276ffb1c48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Creating offline snapshot 9e890d3b-94bb-49bc-9bed-7652f6c4b485 of volume f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:41:56 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Volume volume-91a5bf89-61e1-4b38-9388-9378be6036c7 (91a5bf89-61e1-4b38-9388-9378be6036c7): created successfully Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be31dfc-edfa-4b2c-a0b5-276ffb1c48d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Flow 'volume_create_manager' (81e0738c-204a-45e4-88ed-95e7dda0abd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285d460-3f85-4bb3-b642-12eec43689e3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:41:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b5f98efe-47f6-45ab-9531-3443371f2407 tempest-SnapshotDependencyTests-1685256684 None] Created volume successfully. Jul 08 03:41:56 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e Jul 08 03:41:56 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:41:57 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e" returned: 0 in 0.755s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:57 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 1G Jul 08 03:41:57 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:58 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 1G" returned: 0 in 0.804s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ac5460-0486-4560-be30-9baeadae0a8e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:58 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ac5460-0486-4560-be30-9baeadae0a8e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 Jul 08 03:41:58 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:58 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ac5460-0486-4560-be30-9baeadae0a8e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:58 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 is being set with open permissions: ugo+rw Jul 08 03:41:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:58 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 Jul 08 03:41:58 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:41:59 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 08 03:41:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485" returned: 0 in 0.710s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:41:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:41:59 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info Jul 08 03:41:59 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:00 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info" returned: 0 in 0.661s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:00 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info is being set with open permissions: ugo+rw Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:00 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info Jul 08 03:42:00 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:00 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.info" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.770s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Creating offline snapshot e8bbca8e-1484-442b-b1f8-fd7002e5dc60 of volume 91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fb8c24-f9fc-4611-beb1-4532adfd4776]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-185f48a1-0766-4162-8c41-122c6401d305 tempest-VolumesSnapshotTestJSON-544264329 None] Create snapshot completed successfully Jul 08 03:42:01 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:42:01 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:01 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 0.827s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:01 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 1G Jul 08 03:42:01 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-9e890d3b-94bb-49bc-9bed-7652f6c4b485-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-9e890d3b-94bb-49bc-9bed-7652f6c4b485-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-f4ac5460-0486-4560-be30-9baeadae0a8e" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-f4ac5460-0486-4560-be30-9baeadae0a8e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-9e890d3b-94bb-49bc-9bed-7652f6c4b485" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-9e890d3b-94bb-49bc-9bed-7652f6c4b485" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Deleting offline snapshot 9e890d3b-94bb-49bc-9bed-7652f6c4b485 of volume f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] snapshot_file for this snap is: volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0109ce90-1f85-49c5-89f7-a2b353a10f46]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:02 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 Jul 08 03:42:02 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:02 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 1G" returned: 0 in 0.857s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a5bf89-61e1-4b38-9388-9378be6036c7 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:02 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a5bf89-61e1-4b38-9388-9378be6036c7 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 Jul 08 03:42:02 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:03 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ac5460-0486-4560-be30-9baeadae0a8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e57f63-cc3d-4291-b2cc-64a3f864fb27]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:03 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e Jul 08 03:42:03 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Flow 'volume_create_manager' (2facca15-7641-46e0-a272-b33334d11e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95cefee-fc70-43f6-9ab3-e67781f9cdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95cefee-fc70-43f6-9ab3-e67781f9cdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1724331461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e73507-e468-4f1d-8c2d-b2c980011654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2f92a6e0324dd0b1ab2c85b1670cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f223b95-789e-47ef-90ec-75eef19928e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:03Z,use_quota=True,user_id='2147e6fde28543d7bc97a29fce811b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425be700-9008-40de-b00c-0ac6d420476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425be700-9008-40de-b00c-0ac6d420476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb60848b-ccef-4bdd-857a-87f689bb2043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb60848b-ccef-4bdd-857a-87f689bb2043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3e73507-e468-4f1d-8c2d-b2c980011654', 'volume_name': 'volume-e3e73507-e468-4f1d-8c2d-b2c980011654', 'volume_size': 1, 'snapshot_id': '1f223b95-789e-47ef-90ec-75eef19928e3'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba94992-e172-4a8d-987a-dcc847c89950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba94992-e172-4a8d-987a-dcc847c89950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fb0d70-7397-4839-84aa-cdf57576ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:03 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Volume e3e73507-e468-4f1d-8c2d-b2c980011654: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3e73507-e468-4f1d-8c2d-b2c980011654', 'volume_size': 1, 'snapshot_id': '1f223b95-789e-47ef-90ec-75eef19928e3'} Jul 08 03:42:03 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a5bf89-61e1-4b38-9388-9378be6036c7 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60" returned: 0 in 0.862s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:03 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 is being set with open permissions: ugo+rw Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:03 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 Jul 08 03:42:03 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:04 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e" returned: 0 in 0.908s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:04 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 Jul 08 03:42:04 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:04 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60" returned: 0 in 0.756s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:04 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info Jul 08 03:42:04 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:04 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485" returned: 0 in 0.813s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:04 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485 Jul 08 03:42:04 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:05 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info" returned: 0 in 0.691s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:05 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info is being set with open permissions: ugo+rw Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:05 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info Jul 08 03:42:05 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:05 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e.9e890d3b-94bb-49bc-9bed-7652f6c4b485" returned: 0 in 0.681s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-9e890d3b-94bb-49bc-9bed-7652f6c4b485" released by "_delete_snapshot" :: held 3.396s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-f4ac5460-0486-4560-be30-9baeadae0a8e" released by "delete_snapshot" :: held 3.424s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['55556fe3-52bb-4254-842d-2f3df17cc56b', 'e1ae9929-51ab-4f2a-9963-1cee94795cd4', '4cd0401f-e6ca-4bdf-b6e1-27bc10afadc0', '0b8b7a2e-2948-460e-bd1c-2b6f504c7400'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:05 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Delete snapshot completed successfully. Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-09207272-0580-45ef-b8bb-1479bdd625af tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-9e890d3b-94bb-49bc-9bed-7652f6c4b485-delete_snapshot" released by "delete_snapshot" :: held 3.609s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:05 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.info" returned: 0 in 0.701s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.822s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.201s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-quobyte-1f223b95-789e-47ef-90ec-75eef19928e3-e3e73507-e468-4f1d-8c2d-b2c980011654" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-1f223b95-789e-47ef-90ec-75eef19928e3-e3e73507-e468-4f1d-8c2d-b2c980011654" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Creating volume e3e73507-e468-4f1d-8c2d-b2c980011654 from snapshot 1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-quobyte-e3e73507-e468-4f1d-8c2d-b2c980011654" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:05 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-551a9559-1178-4e80-9e51-ecca1af72d13 tempest-SnapshotDependencyTests-1685256684 None] Create snapshot completed successfully Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-e3e73507-e468-4f1d-8c2d-b2c980011654" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] snapshot: 1f223b95-789e-47ef-90ec-75eef19928e3, volume: e3e73507-e468-4f1d-8c2d-b2c980011654, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff2143-ee9b-4046-9a8c-97faf81ff054]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:05 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 Jul 08 03:42:05 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:06 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3" returned: 0 in 0.848s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b7cded-f1bc-4e37-a4b8-8b5be465c286]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:06 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:42:06 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:06 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (7db3e3d1-0d30-4be1-b06a-9e01cac1a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592d506e-e8f7-412e-ad0c-e704c8b18da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592d506e-e8f7-412e-ad0c-e704c8b18da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-469181548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a70afe6-c409-4263-a712-76db9c545f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:07Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576bc6b3-5622-4fd8-898e-f3fa4c6f2117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576bc6b3-5622-4fd8-898e-f3fa4c6f2117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93560279-363c-4233-904f-08fbfe23f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93560279-363c-4233-904f-08fbfe23f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a70afe6-c409-4263-a712-76db9c545f3e', 'volume_name': 'volume-2a70afe6-c409-4263-a712-76db9c545f3e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070ed073-6314-47d5-97d8-99003b6820d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070ed073-6314-47d5-97d8-99003b6820d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2144fc5a-4d08-42eb-9c7d-8831705f4df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Volume 2a70afe6-c409-4263-a712-76db9c545f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a70afe6-c409-4263-a712-76db9c545f3e', 'volume_size': 1} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Flow 'volume_create_manager' (8ebd1996-90a1-4381-9b87-71e3b2731505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b872995e-3a0e-4777-ae7b-2fbc5c500387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b872995e-3a0e-4777-ae7b-2fbc5c500387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2462b148f9d047e6a3acde791efcfbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8bbca8e-1484-442b-b1f8-fd7002e5dc60,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:07Z,use_quota=True,user_id='ff2e85d117334ca782d75e80db4b09b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b633d8-b98b-47d4-85af-50c824dde990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b633d8-b98b-47d4-85af-50c824dde990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94410fc1-ab52-4159-8ecc-62993ee0458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94410fc1-ab52-4159-8ecc-62993ee0458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea', 'volume_name': 'volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea', 'volume_size': 1, 'snapshot_id': 'e8bbca8e-1484-442b-b1f8-fd7002e5dc60'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee30b98-85e8-4ae8-921c-37d77225418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee30b98-85e8-4ae8-921c-37d77225418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4f965a-43c7-462a-a930-1b8d74bfd775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Volume 41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea', 'volume_size': 1, 'snapshot_id': 'e8bbca8e-1484-442b-b1f8-fd7002e5dc60'} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:07 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 0.847s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:42:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:07 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 Jul 08 03:42:07 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:13 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654" returned: 0 in 6.163s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bd6692-e281-41f2-a2f9-deb7d0132fe3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:13 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:42:13 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:14 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 1.164s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:14 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:42:14 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Converted 1024.00 MB image at 166.12 MB/s Jul 08 03:42:14 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 is being set with open permissions: ugo+rw Jul 08 03:42:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:14 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 Jul 08 03:42:14 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:15 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654" returned: 0 in 0.659s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-e3e73507-e468-4f1d-8c2d-b2c980011654" released by "_copy_volume_from_snapshot" :: held 9.790s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-1f223b95-789e-47ef-90ec-75eef19928e3-e3e73507-e468-4f1d-8c2d-b2c980011654" released by "_create_volume_from_snapshot" :: held 9.827s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.848s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.495s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-469181548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a70afe6-c409-4263-a712-76db9c545f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:07Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Creating volume 2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:42:15 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:15 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e 1073741824 Jul 08 03:42:15 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fb0d70-7397-4839-84aa-cdf57576ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e73507-e468-4f1d-8c2d-b2c980011654', 'volume_size': 1, 'snapshot_id': '1f223b95-789e-47ef-90ec-75eef19928e3'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b607ce-968c-4468-9139-f01e8c4ce334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Volume volume-e3e73507-e468-4f1d-8c2d-b2c980011654 (e3e73507-e468-4f1d-8c2d-b2c980011654): created successfully Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b607ce-968c-4468-9139-f01e8c4ce334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Flow 'volume_create_manager' (2facca15-7641-46e0-a272-b33334d11e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2cd3fc48-aed5-4ef8-9d1e-8063e2b9ffea tempest-TestStampPattern-1482223669 None] Created volume successfully. Jul 08 03:42:16 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e 1073741824" returned: 0 in 0.871s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:16 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:16 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:17 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 0.768s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.867s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-quobyte-e8bbca8e-1484-442b-b1f8-fd7002e5dc60-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2144fc5a-4d08-42eb-9c7d-8831705f4df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a70afe6-c409-4263-a712-76db9c545f3e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69533fcf-d814-4230-a4fb-55ab8872a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-e8bbca8e-1484-442b-b1f8-fd7002e5dc60-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Creating volume 41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea from snapshot e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-quobyte-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Volume volume-2a70afe6-c409-4263-a712-76db9c545f3e (2a70afe6-c409-4263-a712-76db9c545f3e): created successfully Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69533fcf-d814-4230-a4fb-55ab8872a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (7db3e3d1-0d30-4be1-b06a-9e01cac1a80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] snapshot: e8bbca8e-1484-442b-b1f8-fd7002e5dc60, volume: 41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-298a271b-34e0-4d12-a30d-3eab58266090 tempest-VolumesSnapshotTestJSON-544264329 None] Created volume successfully. Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a452b0d-56bf-4132-96b2-a77ab0213884]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:17 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 Jul 08 03:42:17 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:18 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60" returned: 0 in 0.765s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91a5bf89-61e1-4b38-9388-9378be6036c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f567f88-8c85-445d-9315-29489bbc87fe]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:18 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:42:18 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:18 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 0.836s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:42:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:19 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea Jul 08 03:42:19 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:25 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" returned: 0 in 6.488s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cea1f7-85fc-4a63-8ab8-2ef08a40c79e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:25 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:42:25 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:26 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 1.040s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:26 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:42:26 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Converted 1024.00 MB image at 157.79 MB/s Jul 08 03:42:26 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea is being set with open permissions: ugo+rw Jul 08 03:42:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:26 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea Jul 08 03:42:26 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:27 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" released by "_copy_volume_from_snapshot" :: held 9.915s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-e8bbca8e-1484-442b-b1f8-fd7002e5dc60-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" released by "_create_volume_from_snapshot" :: held 9.962s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.993s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.882s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Creating offline snapshot e1064d14-0fcd-4931-a966-0a406afb2e46 of volume 2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4f965a-43c7-462a-a930-1b8d74bfd775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea', 'volume_size': 1, 'snapshot_id': 'e8bbca8e-1484-442b-b1f8-fd7002e5dc60'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4957b8c-2cb3-485b-a55d-041b3961aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a0406-9fb3-4973-a1ad-7c59d88a3ff3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Volume volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea (41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea): created successfully Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4957b8c-2cb3-485b-a55d-041b3961aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Flow 'volume_create_manager' (8ebd1996-90a1-4381-9b87-71e3b2731505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a68206d7-351c-41a2-954a-51cd6684698c tempest-SnapshotDependencyTests-1685256684 None] Created volume successfully. Jul 08 03:42:27 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:27 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-e8bbca8e-1484-442b-b1f8-fd7002e5dc60-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-e8bbca8e-1484-442b-b1f8-fd7002e5dc60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-quobyte-91a5bf89-61e1-4b38-9388-9378be6036c7" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-91a5bf89-61e1-4b38-9388-9378be6036c7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-quobyte-e8bbca8e-1484-442b-b1f8-fd7002e5dc60" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-e8bbca8e-1484-442b-b1f8-fd7002e5dc60" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Deleting offline snapshot e8bbca8e-1484-442b-b1f8-fd7002e5dc60 of volume 91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] snapshot_file for this snap is: volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a2e4b-4f64-480d-8ebe-03add3ae249f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:27 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 Jul 08 03:42:27 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:28 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 0.934s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:28 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 1G Jul 08 03:42:28 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:28 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60" returned: 0 in 0.822s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91a5bf89-61e1-4b38-9388-9378be6036c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:42:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[528e138f-afba-468c-a8b0-c68bfe91265e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:28 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:42:28 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:29 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 1G" returned: 0 in 0.867s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a70afe6-c409-4263-a712-76db9c545f3e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:29 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a70afe6-c409-4263-a712-76db9c545f3e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 Jul 08 03:42:29 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:29 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 0.826s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:29 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 Jul 08 03:42:29 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:29 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a70afe6-c409-4263-a712-76db9c545f3e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:29 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 is being set with open permissions: ugo+rw Jul 08 03:42:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:29 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 Jul 08 03:42:29 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:30 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:30 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60 Jul 08 03:42:30 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:30 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46" returned: 0 in 0.664s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:30 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info Jul 08 03:42:30 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:30 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7.e8bbca8e-1484-442b-b1f8-fd7002e5dc60" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-e8bbca8e-1484-442b-b1f8-fd7002e5dc60" released by "_delete_snapshot" :: held 3.207s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-91a5bf89-61e1-4b38-9388-9378be6036c7" released by "delete_snapshot" :: held 3.235s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Created reservations ['15b1b624-1ce0-43ff-b952-be7eef8e94e5', '3a58839f-f6db-47db-a49a-5dc9befbce7d', 'eeaad9e8-f9d4-4ed4-897b-71a150571230', 'f235366f-4824-44a2-b9f4-27a9d752c0a6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Delete snapshot completed successfully. Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0196ce47-a707-45aa-9af1-04c3af09382a tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-e8bbca8e-1484-442b-b1f8-fd7002e5dc60-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:31 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info" returned: 0 in 0.752s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:31 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info is being set with open permissions: ugo+rw Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:31 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info Jul 08 03:42:31 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:31 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.info" returned: 0 in 0.627s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.676s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-91a5bf89-61e1-4b38-9388-9378be6036c7-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3cf1880c-c961-4829-8c72-3ba856954409 tempest-VolumesSnapshotTestJSON-544264329 None] Create snapshot completed successfully Jul 08 03:42:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-91a5bf89-61e1-4b38-9388-9378be6036c7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-quobyte-91a5bf89-61e1-4b38-9388-9378be6036c7" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-91a5bf89-61e1-4b38-9388-9378be6036c7" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9a1ef-fc8f-420d-a629-255572172dea]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:32 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:42:32 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (0ee2a7fc-34bf-4688-b2d4-5081fba72c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23b3b59-a855-4a7c-8c4b-8ff3ed369aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23b3b59-a855-4a7c-8c4b-8ff3ed369aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1107283918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8191d4a-f3ae-4701-938c-ba5969d8d56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e1064d14-0fcd-4931-a966-0a406afb2e46,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:33Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58bc79b-d56b-4df9-bed7-a3103363058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58bc79b-d56b-4df9-bed7-a3103363058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea8b448-f1d1-41cd-8aef-1efc1c93336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea8b448-f1d1-41cd-8aef-1efc1c93336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8191d4a-f3ae-4701-938c-ba5969d8d56c', 'volume_name': 'volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c', 'volume_size': 2, 'snapshot_id': 'e1064d14-0fcd-4931-a966-0a406afb2e46'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5e9f0c-af99-4d23-9f34-a798abc6dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5e9f0c-af99-4d23-9f34-a798abc6dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae7a87-9f10-4187-92a6-59aa830322fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:32 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Volume e8191d4a-f3ae-4701-938c-ba5969d8d56c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c', 'volume_size': 2, 'snapshot_id': 'e1064d14-0fcd-4931-a966-0a406afb2e46'} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-e1064d14-0fcd-4931-a966-0a406afb2e46-e8191d4a-f3ae-4701-938c-ba5969d8d56c" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e1064d14-0fcd-4931-a966-0a406afb2e46-e8191d4a-f3ae-4701-938c-ba5969d8d56c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Creating volume e8191d4a-f3ae-4701-938c-ba5969d8d56c from snapshot e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-e8191d4a-f3ae-4701-938c-ba5969d8d56c" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:32 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e8191d4a-f3ae-4701-938c-ba5969d8d56c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] snapshot: e1064d14-0fcd-4931-a966-0a406afb2e46, volume: e8191d4a-f3ae-4701-938c-ba5969d8d56c, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:32 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7 Jul 08 03:42:32 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0741367d-1e23-48b5-9cc9-bc8256c17901]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:33 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 Jul 08 03:42:33 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:33 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-91a5bf89-61e1-4b38-9388-9378be6036c7" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-91a5bf89-61e1-4b38-9388-9378be6036c7" released by "delete_volume" :: held 1.495s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Created reservations ['7dfbe8a1-b200-475a-b9a2-548f36fe49fb', '9baa19c7-5bc9-418a-a612-e09d32c0524e', '6d9b6d6c-c482-49da-ac80-66829432c048', '987bce17-6f08-4939-b1fa-ab5475d78462'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:33 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a70afe6-c409-4263-a712-76db9c545f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:42:33 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:42:33 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda6e8b3-745a-4265-96c0-17b516225a50]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:33 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:33 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "cinder-quobyte-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a682f59-5d5c-4b03-a0d9-5c78a1afac74]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:34 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.690s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:42:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Deleted volume successfully. Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-48fb97de-b528-4d00-ae7d-7b557d937be2 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-91a5bf89-61e1-4b38-9388-9378be6036c7-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:34 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea Jul 08 03:42:34 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:34 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 0.802s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:42:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:34 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c Jul 08 03:42:34 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:35 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:35 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea Jul 08 03:42:35 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:36 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" returned: 0 in 0.997s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-quobyte-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea" released by "delete_volume" :: held 1.826s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Created reservations ['2358651d-6142-461c-8e78-a0b029e4f42e', 'e15f896d-933c-4604-b39c-0355bdcaa24c', '48e64b49-495c-4e5c-ad8c-9cd143ec673c', '653735a4-face-4825-9fb8-ed7cd1482404'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:36 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:42:36 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:38 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:38 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:42:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Deleted volume successfully. Jul 08 03:42:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-13b98ca8-9072-464c-aaa8-e7501b1bc2b9 tempest-SnapshotDependencyTests-1685256684 None] Lock "cinder-41413e5d-9b2b-4a75-aaaa-4f2d5fa450ea-delete_volume" released by "delete_volume" :: held 3.908s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:39 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c" returned: 0 in 5.432s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6117e2-4f2a-4c31-a3db-b0d9f010611a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:40 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:40 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:40 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 1.024s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:40 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:42:40 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Converted 1024.00 MB image at 188.49 MB/s Jul 08 03:42:40 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c is being set with open permissions: ugo+rw Jul 08 03:42:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:40 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c Jul 08 03:42:40 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:41 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c" returned: 0 in 0.747s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e8191d4a-f3ae-4701-938c-ba5969d8d56c" released by "_copy_volume_from_snapshot" :: held 8.885s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e1064d14-0fcd-4931-a966-0a406afb2e46-e8191d4a-f3ae-4701-938c-ba5969d8d56c" released by "_create_volume_from_snapshot" :: held 8.918s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.933s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae7a87-9f10-4187-92a6-59aa830322fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c', 'volume_size': 2, 'snapshot_id': 'e1064d14-0fcd-4931-a966-0a406afb2e46'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48dec6c-9dd5-4286-ae7a-618a18d05332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Volume volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c (e8191d4a-f3ae-4701-938c-ba5969d8d56c): created successfully Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48dec6c-9dd5-4286-ae7a-618a18d05332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (0ee2a7fc-34bf-4688-b2d4-5081fba72c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:41 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ee6a61ea-2d14-4978-afe5-33fb58650e3c tempest-VolumesSnapshotTestJSON-544264329 None] Created volume successfully. Jul 08 03:42:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-e8191d4a-f3ae-4701-938c-ba5969d8d56c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-e8191d4a-f3ae-4701-938c-ba5969d8d56c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-e8191d4a-f3ae-4701-938c-ba5969d8d56c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e8191d4a-f3ae-4701-938c-ba5969d8d56c" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:42 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdb626b-2183-481a-9237-d1241769a3a9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:42 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c Jul 08 03:42:42 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:43 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c" returned: 0 in 0.848s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:43 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c Jul 08 03:42:43 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:44 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e8191d4a-f3ae-4701-938c-ba5969d8d56c" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e8191d4a-f3ae-4701-938c-ba5969d8d56c" released by "delete_volume" :: held 1.570s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['b14605b9-fcd5-4fed-9dbd-1589c6e3a428', 'dda228d2-bceb-4956-924b-88d758a6f298', '731b0b16-74c9-48d2-99a2-235113cc91a5', '26acb70f-b4e8-4d73-b5e0-dab6b8ec00a7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:44 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:42:44 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-e1064d14-0fcd-4931-a966-0a406afb2e46-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-e1064d14-0fcd-4931-a966-0a406afb2e46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-2a70afe6-c409-4263-a712-76db9c545f3e" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-2a70afe6-c409-4263-a712-76db9c545f3e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-e1064d14-0fcd-4931-a966-0a406afb2e46" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e1064d14-0fcd-4931-a966-0a406afb2e46" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Deleting offline snapshot e1064d14-0fcd-4931-a966-0a406afb2e46 of volume 2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] snapshot_file for this snap is: volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f42ca3-aa38-47f2-b01f-26deab486f3c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:45 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:42:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Deleted volume successfully. Jul 08 03:42:45 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 Jul 08 03:42:45 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2f8624cf-bceb-491b-91c3-c1f0febd677f tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-e8191d4a-f3ae-4701-938c-ba5969d8d56c-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:45 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46" returned: 0 in 0.833s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a70afe6-c409-4263-a712-76db9c545f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e245f65-ed51-44af-8a1f-402ee09114b5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:46 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:46 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:46 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:46 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 Jul 08 03:42:46 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:47 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:42:47 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:47 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46" returned: 0 in 0.839s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:47 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46 Jul 08 03:42:47 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:47 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.703s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:42:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:42:48 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e.e1064d14-0fcd-4931-a966-0a406afb2e46" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:48 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=63,cinder:UPDATE=57,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:42:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-e1064d14-0fcd-4931-a966-0a406afb2e46" released by "_delete_snapshot" :: held 3.266s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-2a70afe6-c409-4263-a712-76db9c545f3e" released by "delete_snapshot" :: held 3.290s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:48 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['31ed2bb9-9bb2-432a-8312-b1e3ac6a4f9d', 'b38fa878-8762-41ad-9ea5-a6c41518030f', '7f1a5631-472d-4ed7-8b0f-4acab3168efb', '2a15d90a-5142-42ae-9af1-e8fbda8c7b9c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Delete snapshot completed successfully. Jul 08 03:42:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-770c2510-fc96-4eee-8972-14713de02072 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-e1064d14-0fcd-4931-a966-0a406afb2e46-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-2a70afe6-c409-4263-a712-76db9c545f3e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-2a70afe6-c409-4263-a712-76db9c545f3e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-2a70afe6-c409-4263-a712-76db9c545f3e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-2a70afe6-c409-4263-a712-76db9c545f3e" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f8b2d-9bdf-4538-8ad7-294e873742a3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:49 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:49 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d5a5f-68c1-478b-bfdb-aa99a18a517d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:49 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 Jul 08 03:42:49 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:50 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 0.765s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:50 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e Jul 08 03:42:50 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:50 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654" returned: 0 in 0.770s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-e3e73507-e468-4f1d-8c2d-b2c980011654', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b00109cd-75c3-456f-b867-9b1c9650319a', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:42:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-5639ef8a-4215-4b78-a7c0-0bce24845af8 req-5a7e0034-bef7-4844-9e92-47194052981b tempest-TestStampPattern-1482223669 None] attachment_update completed successfully. Jul 08 03:42:50 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2a70afe6-c409-4263-a712-76db9c545f3e" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-2a70afe6-c409-4263-a712-76db9c545f3e" released by "delete_volume" :: held 1.509s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:50 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['37f902d8-4fba-45ac-824e-b70298fe4111', '0f519d6f-399f-48b9-b0cf-8414135ccab1', '7658499d-90c5-4006-8cdb-f8a18be85cf1', '9e604e31-4f0c-4b15-8abe-6fa4c38218cb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:51 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:42:51 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:51 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.683s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:42:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Deleted volume successfully. Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=71,cinder:UPDATE=74,cinder:DELETE=8,cinder:INSERT=17 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:42:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-61b306b2-6376-42ff-bfca-a1a9922bfac4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-2a70afe6-c409-4263-a712-76db9c545f3e-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (a9b25601-77d0-4b01-8685-e0bf2aaab8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3bfd0d-3159-45ca-9813-45723d9fa050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3bfd0d-3159-45ca-9813-45723d9fa050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-408335477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e124e7-11c6-44d0-9d29-610613d636d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:52Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6805aeaa-a38d-4173-913a-a9be5c1460d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6805aeaa-a38d-4173-913a-a9be5c1460d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17389b7c-b195-4c9f-ba3a-fefc6f0a5a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17389b7c-b195-4c9f-ba3a-fefc6f0a5a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e124e7-11c6-44d0-9d29-610613d636d1', 'volume_name': 'volume-01e124e7-11c6-44d0-9d29-610613d636d1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835f047a-292d-45b6-985a-b09d667500c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835f047a-292d-45b6-985a-b09d667500c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3ba42b-2fa6-4eb6-bd0c-e9397da4ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Volume 01e124e7-11c6-44d0-9d29-610613d636d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e124e7-11c6-44d0-9d29-610613d636d1', 'volume_size': 1} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-408335477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e124e7-11c6-44d0-9d29-610613d636d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:42:52Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Creating volume 01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:42:52 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:42:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:52 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 1073741824 Jul 08 03:42:52 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:53 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 1073741824" returned: 0 in 0.817s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:53 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:42:53 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:53 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.627s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3ba42b-2fa6-4eb6-bd0c-e9397da4ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e124e7-11c6-44d0-9d29-610613d636d1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8895b4a2-6022-4e96-9a82-caddd28849d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:42:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Volume volume-01e124e7-11c6-44d0-9d29-610613d636d1 (01e124e7-11c6-44d0-9d29-610613d636d1): created successfully Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8895b4a2-6022-4e96-9a82-caddd28849d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:42:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (a9b25601-77d0-4b01-8685-e0bf2aaab8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:42:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2cb5552f-22fc-462f-a93d-f34b64a14af8 tempest-VolumesSnapshotTestJSON-544264329 None] Created volume successfully. Jul 08 03:42:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:42:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:42:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Creating offline snapshot dcd197e8-67df-4bd3-9e43-b4aa192ce758 of volume 01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:42:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67d2f11-9075-4939-9c84-0998fa7cfd5d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:42:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:54 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:42:54 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:55 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:55 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 1G Jul 08 03:42:55 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:55 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 1G" returned: 0 in 0.830s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e124e7-11c6-44d0-9d29-610613d636d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:56 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e124e7-11c6-44d0-9d29-610613d636d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 Jul 08 03:42:56 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:56 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e124e7-11c6-44d0-9d29-610613d636d1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758" returned: 0 in 0.670s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:56 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 is being set with open permissions: ugo+rw Jul 08 03:42:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:56 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 Jul 08 03:42:56 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-e3301019-7d81-4082-b6be-d2183f6fa1e5 req-6e536e58-12af-4740-b140-0ffb203cf3a4 tempest-TestStampPattern-1482223669 None] Terminate volume connection completed successfully. Jul 08 03:42:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-e3301019-7d81-4082-b6be-d2183f6fa1e5 req-6e536e58-12af-4740-b140-0ffb203cf3a4 tempest-TestStampPattern-1482223669 None] Deleting attachment b00109cd-75c3-456f-b867-9b1c9650319a. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:42:57 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758" returned: 0 in 0.668s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:57 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info Jul 08 03:42:57 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:57 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:57 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info is being set with open permissions: ugo+rw Jul 08 03:42:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:42:58 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info Jul 08 03:42:58 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:42:58 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 08 03:42:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.info" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:42:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.345s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:42:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-dd111e93-55ad-4f48-b976-5486d79a2568 tempest-VolumesSnapshotTestJSON-544264329 None] Create snapshot completed successfully Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (c4437a53-bb71-4b96-87c4-70e2337cb8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200d728e-f1e2-493a-85cd-b7cb50393b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200d728e-f1e2-493a-85cd-b7cb50393b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1187970985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cbebf3-2044-4306-be03-c574a1cfd942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d093ba34918f4b8c88d5c9e1644cd746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dcd197e8-67df-4bd3-9e43-b4aa192ce758,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:00Z,use_quota=True,user_id='2e67290f335e49ff8c5da4eda92817bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096dee79-ddb1-4636-a57e-3324e115444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096dee79-ddb1-4636-a57e-3324e115444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe2b46-deb2-432b-a175-dc5412d396bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe2b46-deb2-432b-a175-dc5412d396bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02cbebf3-2044-4306-be03-c574a1cfd942', 'volume_name': 'volume-02cbebf3-2044-4306-be03-c574a1cfd942', 'volume_size': 1, 'snapshot_id': 'dcd197e8-67df-4bd3-9e43-b4aa192ce758'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96831b3-ab32-4a23-9ddc-08bca89454af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96831b3-ab32-4a23-9ddc-08bca89454af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491a6914-274d-488a-a9f7-062f0caff553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:00 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Volume 02cbebf3-2044-4306-be03-c574a1cfd942: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02cbebf3-2044-4306-be03-c574a1cfd942', 'volume_size': 1, 'snapshot_id': 'dcd197e8-67df-4bd3-9e43-b4aa192ce758'} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-dcd197e8-67df-4bd3-9e43-b4aa192ce758-02cbebf3-2044-4306-be03-c574a1cfd942" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-dcd197e8-67df-4bd3-9e43-b4aa192ce758-02cbebf3-2044-4306-be03-c574a1cfd942" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Creating volume 02cbebf3-2044-4306-be03-c574a1cfd942 from snapshot dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-02cbebf3-2044-4306-be03-c574a1cfd942" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-02cbebf3-2044-4306-be03-c574a1cfd942" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] snapshot: dcd197e8-67df-4bd3-9e43-b4aa192ce758, volume: 02cbebf3-2044-4306-be03-c574a1cfd942, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6acf0a0-c1fe-4e9d-89f1-32cde50cde51]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:00 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 Jul 08 03:43:00 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:01 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758" returned: 0 in 0.776s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e124e7-11c6-44d0-9d29-610613d636d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:43:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:43:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:43:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6838eba8-7066-45c3-910f-9e78e65a953c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:01 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:43:01 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:01 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.932s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:02 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:43:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:02 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 Jul 08 03:43:02 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:07 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942" returned: 0 in 5.068s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:07 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf4fba-07b6-4cad-bfd2-a9ec9c2cd8a9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:07 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:43:07 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:08 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.933s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:43:08 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Converted 1024.00 MB image at 201.87 MB/s Jul 08 03:43:08 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 is being set with open permissions: ugo+rw Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:08 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 Jul 08 03:43:08 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:08 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942" returned: 0 in 0.641s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-02cbebf3-2044-4306-be03-c574a1cfd942" released by "_copy_volume_from_snapshot" :: held 8.438s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-dcd197e8-67df-4bd3-9e43-b4aa192ce758-02cbebf3-2044-4306-be03-c574a1cfd942" released by "_create_volume_from_snapshot" :: held 8.466s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.488s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491a6914-274d-488a-a9f7-062f0caff553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cbebf3-2044-4306-be03-c574a1cfd942', 'volume_size': 1, 'snapshot_id': 'dcd197e8-67df-4bd3-9e43-b4aa192ce758'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a85fab-2370-45e7-9c63-8810ce53021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:08 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Volume volume-02cbebf3-2044-4306-be03-c574a1cfd942 (02cbebf3-2044-4306-be03-c574a1cfd942): created successfully Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a85fab-2370-45e7-9c63-8810ce53021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Flow 'volume_create_manager' (c4437a53-bb71-4b96-87c4-70e2337cb8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8f437472-c189-4e22-aab9-ffebadd25686 tempest-VolumesSnapshotTestJSON-544264329 None] Created volume successfully. Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-e3e73507-e468-4f1d-8c2d-b2c980011654-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Lock "cinder-e3e73507-e468-4f1d-8c2d-b2c980011654-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-02cbebf3-2044-4306-be03-c574a1cfd942-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-quobyte-e3e73507-e468-4f1d-8c2d-b2c980011654" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-02cbebf3-2044-4306-be03-c574a1cfd942-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-e3e73507-e468-4f1d-8c2d-b2c980011654" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ce77c9-911d-4550-b9a0-b59f3998588b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-02cbebf3-2044-4306-be03-c574a1cfd942" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-02cbebf3-2044-4306-be03-c574a1cfd942" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb3780-b0f3-419b-9058-423b175f33c5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:09 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 Jul 08 03:43:09 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:09 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 Jul 08 03:43:09 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:09 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654" returned: 0 in 0.740s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:09 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654 Jul 08 03:43:09 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:09 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942" returned: 0 in 0.742s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:09 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942 Jul 08 03:43:09 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:10 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e3e73507-e468-4f1d-8c2d-b2c980011654" returned: 0 in 0.634s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-e3e73507-e468-4f1d-8c2d-b2c980011654" released by "delete_volume" :: held 1.418s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Created reservations ['3bee2d5f-09dc-4672-b0e6-1d43c5e3faf8', '42bd6e7c-b3d9-4fac-8989-632820006924', '68dceb2e-46ec-49e2-aa40-30bcf477beda', 'a6bd4d79-8c7a-4d79-ba48-6e1ed8f6d8a6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:10 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-02cbebf3-2044-4306-be03-c574a1cfd942" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-02cbebf3-2044-4306-be03-c574a1cfd942" released by "delete_volume" :: held 1.436s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['926b108f-e0fb-4cb5-8601-977be4d933b7', '6186e801-6176-4bfc-8b9e-4720433f640e', '31188cd2-880f-4284-8cac-ba576025dbdb', '161179e7-447a-49da-9bbb-c07733414982'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:10 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:10 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:10 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:10 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:11 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Deleted volume successfully. Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-dcd197e8-67df-4bd3-9e43-b4aa192ce758-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03f7c12d-89d7-495f-90e2-78e758219931 tempest-TestStampPattern-1482223669 None] Lock "cinder-e3e73507-e468-4f1d-8c2d-b2c980011654-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-dcd197e8-67df-4bd3-9e43-b4aa192ce758-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-01e124e7-11c6-44d0-9d29-610613d636d1" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:11 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Deleted volume successfully. Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-01e124e7-11c6-44d0-9d29-610613d636d1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-dcd197e8-67df-4bd3-9e43-b4aa192ce758" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3df56e7a-f896-476c-8a3e-7da1635fadfc tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-02cbebf3-2044-4306-be03-c574a1cfd942-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-dcd197e8-67df-4bd3-9e43-b4aa192ce758" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Deleting offline snapshot dcd197e8-67df-4bd3-9e43-b4aa192ce758 of volume 01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] snapshot_file for this snap is: volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[20492a51-11b4-42e2-9d1a-ff0a2c406678]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-1f223b95-789e-47ef-90ec-75eef19928e3-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Lock "cinder-1f223b95-789e-47ef-90ec-75eef19928e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-quobyte-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-quobyte-1f223b95-789e-47ef-90ec-75eef19928e3" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-1f223b95-789e-47ef-90ec-75eef19928e3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Deleting offline snapshot 1f223b95-789e-47ef-90ec-75eef19928e3 of volume bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:43:11 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 Jul 08 03:43:11 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] snapshot_file for this snap is: volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5942c116-47f7-4930-991c-3a9990a77703]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:11 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 Jul 08 03:43:11 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:12 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e124e7-11c6-44d0-9d29-610613d636d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[866f83b6-5534-4aa6-8289-cf5f3d065058]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:12 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3" returned: 0 in 0.766s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdb5a40-1800-496e-b847-a0e11f299ac8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:12 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:43:12 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:12 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:43:12 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:12 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.761s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:13 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 Jul 08 03:43:13 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:13 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 0.756s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:13 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 Jul 08 03:43:13 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:13 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758" returned: 0 in 0.757s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:13 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758 Jul 08 03:43:13 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:13 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:13 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3 Jul 08 03:43:13 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:14 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1.dcd197e8-67df-4bd3-9e43-b4aa192ce758" returned: 0 in 0.660s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-dcd197e8-67df-4bd3-9e43-b4aa192ce758" released by "_delete_snapshot" :: held 3.073s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:14 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3.1f223b95-789e-47ef-90ec-75eef19928e3" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-01e124e7-11c6-44d0-9d29-610613d636d1" released by "delete_snapshot" :: held 3.107s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-1f223b95-789e-47ef-90ec-75eef19928e3" released by "_delete_snapshot" :: held 2.981s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" released by "delete_snapshot" :: held 3.003s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['ce0246e5-1635-4d9b-8690-832490a1eab2', 'e10f5408-76ec-4cf1-8997-27ba11b74ded', '3e33f5ee-9e6b-48c2-a4a3-6c90e0024bda', 'e0ebf7a5-4e48-464a-b6aa-af906ccf9f4d'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Created reservations ['dc50959d-c735-4b04-8d55-6589f7f46d07', 'ce121bf6-c06a-4953-a0ad-1eeeb40e417f', '0cac1508-b588-4f80-9b62-c778833ea594', '1f253d74-9539-48b8-87dd-183317d9e536'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Delete snapshot completed successfully. Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ef2fd317-3c17-4baf-949c-375adecc2f14 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-dcd197e8-67df-4bd3-9e43-b4aa192ce758-delete_snapshot" released by "delete_snapshot" :: held 3.301s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Delete snapshot completed successfully. Jul 08 03:43:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f037cc9-c837-4b44-8d88-aaa5242ba5e8 tempest-TestStampPattern-1482223669 None] Lock "cinder-1f223b95-789e-47ef-90ec-75eef19928e3-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-01e124e7-11c6-44d0-9d29-610613d636d1-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-01e124e7-11c6-44d0-9d29-610613d636d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-01e124e7-11c6-44d0-9d29-610613d636d1" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-01e124e7-11c6-44d0-9d29-610613d636d1" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d82df9-d6f0-4dae-8652-d18b11f40cff]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:15 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:43:15 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:16 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.808s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:16 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1 Jul 08 03:43:16 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:17 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-01e124e7-11c6-44d0-9d29-610613d636d1" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-01e124e7-11c6-44d0-9d29-610613d636d1" released by "delete_volume" :: held 1.543s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['acac2767-911d-45ef-93eb-e0579fda27b1', 'd7004053-cc8e-46a0-9403-244cc2784c5b', '50ec2f9e-4517-45ba-b2dd-678d252e69cf', '239adbc4-1e42-481b-b2d7-c9bef192cbb9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:17 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:17 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-f4ac5460-0486-4560-be30-9baeadae0a8e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-f4ac5460-0486-4560-be30-9baeadae0a8e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "cinder-quobyte-f4ac5460-0486-4560-be30-9baeadae0a8e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-f4ac5460-0486-4560-be30-9baeadae0a8e" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d2f7cd-c376-4fde-88c1-9c31c00a9807]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:18 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:18 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Deleted volume successfully. Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-714aac85-53ad-4188-b7d8-8eb1aa03247b tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-01e124e7-11c6-44d0-9d29-610613d636d1-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:18 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e Jul 08 03:43:18 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:18 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e" returned: 0 in 0.893s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:19 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e Jul 08 03:43:19 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:19 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f4ac5460-0486-4560-be30-9baeadae0a8e" returned: 0 in 0.720s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-quobyte-f4ac5460-0486-4560-be30-9baeadae0a8e" released by "delete_volume" :: held 1.677s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Created reservations ['8cb8dea0-6692-46b7-ae30-1cc216ee39e4', '7ac1ce18-e3f1-4146-bee4-1006c8376214', 'c1a7a921-342c-4650-8cc8-2a844ec5b90e', 'd423befc-a91b-44c8-8dab-28a52e6d29ef'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:19 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:19 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:20 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:20 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:20 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Deleted volume successfully. Jul 08 03:43:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fccb8ca5-372e-4f3d-8e4b-9f1ba00b43a4 tempest-VolumesSnapshotTestJSON-544264329 None] Lock "cinder-f4ac5460-0486-4560-be30-9baeadae0a8e-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-bd093428-1cbc-4846-b6e2-8d5fdd4958e3-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Lock "cinder-bd093428-1cbc-4846-b6e2-8d5fdd4958e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Acquiring lock "cinder-quobyte-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd9b39-0802-483a-ac84-ce0dce5904c7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:23 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:43:23 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:23 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:23 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3 Jul 08 03:43:23 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:24 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" returned: 0 in 0.665s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Lock "cinder-quobyte-bd093428-1cbc-4846-b6e2-8d5fdd4958e3" released by "delete_volume" :: held 1.547s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Created reservations ['dd4581aa-68f6-40b3-89f6-446a8e2790f6', '5f6a6306-cab4-471a-896a-7516e5c570fb', '90c77120-c498-4683-b765-283ece994391', '80a3a399-7d2f-4bdc-9db6-4840f34daefe'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:24 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:24 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:25 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:25 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Deleted volume successfully. Jul 08 03:43:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7663764d-23f6-41bd-83bb-cbfd93018ffd tempest-TestStampPattern-1482223669 None] Lock "cinder-bd093428-1cbc-4846-b6e2-8d5fdd4958e3-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:34 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=69,cinder:INSERT=16,cinder:UPDATE=69,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:43:35 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=37,cinder:INSERT=18,cinder:UPDATE=59,cinder:DELETE=7 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (60e6a59b-f605-4980-acf9-47cc2fc232ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c6d4cc-7307-4412-bc86-685e965936bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c6d4cc-7307-4412-bc86-685e965936bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087041993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459c768f-acef-4754-9553-f2f1d3dbf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:38Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13337f83-a0d8-48f1-9fac-80561450c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13337f83-a0d8-48f1-9fac-80561450c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88948ec-2914-4092-a6dc-1c0ff9a2d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88948ec-2914-4092-a6dc-1c0ff9a2d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459c768f-acef-4754-9553-f2f1d3dbf545', 'volume_name': 'volume-459c768f-acef-4754-9553-f2f1d3dbf545', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ca33d-898d-485f-a51c-2c9f821f1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ca33d-898d-485f-a51c-2c9f821f1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d089ae63-9383-4ec8-a1ed-98fa0556b4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume 459c768f-acef-4754-9553-f2f1d3dbf545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459c768f-acef-4754-9553-f2f1d3dbf545', 'volume_size': 1} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087041993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459c768f-acef-4754-9553-f2f1d3dbf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:38Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Creating volume 459c768f-acef-4754-9553-f2f1d3dbf545 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:38 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 1073741824 Jul 08 03:43:38 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:39 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 1073741824" returned: 0 in 0.998s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:39 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 Jul 08 03:43:39 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:39 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545" returned: 0 in 0.718s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d089ae63-9383-4ec8-a1ed-98fa0556b4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459c768f-acef-4754-9553-f2f1d3dbf545', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886d4203-cc18-437d-8953-eb0cb9f6509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume volume-459c768f-acef-4754-9553-f2f1d3dbf545 (459c768f-acef-4754-9553-f2f1d3dbf545): created successfully Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886d4203-cc18-437d-8953-eb0cb9f6509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (60e6a59b-f605-4980-acf9-47cc2fc232ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-11ee0a34-eff8-4a4d-b86c-cae7dca28934 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created volume successfully. Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (73f3f887-2265-4ea7-a7d2-851f923aae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f35364-ffda-4b33-8cfd-685f71ba6944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f35364-ffda-4b33-8cfd-685f71ba6944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-951810080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63464a73-00a7-407e-80da-68c9201252c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:41Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3681d88-ceac-4505-91a5-5630feb1dec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3681d88-ceac-4505-91a5-5630feb1dec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c3488b-d415-4fb9-9e0f-c4eb2e8429f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c3488b-d415-4fb9-9e0f-c4eb2e8429f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63464a73-00a7-407e-80da-68c9201252c2', 'volume_name': 'volume-63464a73-00a7-407e-80da-68c9201252c2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e344633-9987-4dbb-9a9e-f9ead41160c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e344633-9987-4dbb-9a9e-f9ead41160c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9290e07b-32f4-4ac7-be8b-17d1620f5c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume 63464a73-00a7-407e-80da-68c9201252c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63464a73-00a7-407e-80da-68c9201252c2', 'volume_size': 1} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-951810080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63464a73-00a7-407e-80da-68c9201252c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:41Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Creating volume 63464a73-00a7-407e-80da-68c9201252c2 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:41 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:41 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 1073741824 Jul 08 03:43:41 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (05c19781-7085-43e5-ae1f-33b10c9645f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f14bd0-7f85-4be6-8609-cccc3e4ff5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f14bd0-7f85-4be6-8609-cccc3e4ff5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021322518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126eb6c9-6674-40de-bd8f-05a8289e2ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:41Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27d58a9-ec7a-4703-aa85-680fc7942304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27d58a9-ec7a-4703-aa85-680fc7942304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e469f3-0356-4509-9cb5-a865a6b84c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e469f3-0356-4509-9cb5-a865a6b84c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126eb6c9-6674-40de-bd8f-05a8289e2ac9', 'volume_name': 'volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a9ca85-0922-4bfa-80ee-51f99a7ec6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a9ca85-0922-4bfa-80ee-51f99a7ec6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f429484e-f745-4d0e-b1dd-456cdd05dbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume 126eb6c9-6674-40de-bd8f-05a8289e2ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9', 'volume_size': 1} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (93f0add6-9667-4173-b950-b5e3a11783ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19053379-de93-49eb-987f-56aca1d3a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19053379-de93-49eb-987f-56aca1d3a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538384569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cee39f-20f4-467c-9f27-50f38c9712f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:42Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634062c5-b0d9-4855-8ee3-748202f3eaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634062c5-b0d9-4855-8ee3-748202f3eaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c041c59-409d-4b6f-83a3-13be7211c5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c041c59-409d-4b6f-83a3-13be7211c5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cee39f-20f4-467c-9f27-50f38c9712f3', 'volume_name': 'volume-f7cee39f-20f4-467c-9f27-50f38c9712f3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358faffc-2758-40d6-8a4b-897b271f5dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358faffc-2758-40d6-8a4b-897b271f5dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994511cd-a41a-494a-a513-f45a09d98737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume f7cee39f-20f4-467c-9f27-50f38c9712f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cee39f-20f4-467c-9f27-50f38c9712f3', 'volume_size': 1} Jul 08 03:43:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:42 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 1073741824" returned: 0 in 1.190s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:42 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 Jul 08 03:43:42 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (4a02d15f-d540-4fe8-b418-010b4ae7af38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ee7682-fb60-4347-b1d5-7ca882fcb963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ee7682-fb60-4347-b1d5-7ca882fcb963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558569027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad2bff6-d5fe-4be9-bf48-73b60d040727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:42Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b58f1c5-bebf-4f3d-b622-392f37e78219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b58f1c5-bebf-4f3d-b622-392f37e78219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61a30af-6b01-45e9-8fb7-f9f17118b55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61a30af-6b01-45e9-8fb7-f9f17118b55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad2bff6-d5fe-4be9-bf48-73b60d040727', 'volume_name': 'volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e232d137-17d0-4fd9-a1b0-adac314a1564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e232d137-17d0-4fd9-a1b0-adac314a1564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a23c3f-e88c-4a76-8a7e-fab46300dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:42 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume 2ad2bff6-d5fe-4be9-bf48-73b60d040727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727', 'volume_size': 1} Jul 08 03:43:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (4b97ff20-ccfd-48db-98db-c01196ba09d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79a7574-c0ca-4dc0-9fb9-bdff6f71a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79a7574-c0ca-4dc0-9fb9-bdff6f71a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891319291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46103b09-9060-4ed6-b03a-beee6a49f366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:43Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5018236a-a54b-40a7-bf4b-c1e78b151c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5018236a-a54b-40a7-bf4b-c1e78b151c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:43 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f3681b-63a7-4e0c-94d6-7cbaca72b504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f3681b-63a7-4e0c-94d6-7cbaca72b504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46103b09-9060-4ed6-b03a-beee6a49f366', 'volume_name': 'volume-46103b09-9060-4ed6-b03a-beee6a49f366', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4729ea4-a471-4cc8-9296-bc0654b11026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4729ea4-a471-4cc8-9296-bc0654b11026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb0fcf1-3df0-4ce2-8c5f-91941c5f3da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:43 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume 46103b09-9060-4ed6-b03a-beee6a49f366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46103b09-9060-4ed6-b03a-beee6a49f366', 'volume_size': 1} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2" returned: 0 in 0.843s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021322518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126eb6c9-6674-40de-bd8f-05a8289e2ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:41Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Creating volume 126eb6c9-6674-40de-bd8f-05a8289e2ac9 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:43 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:43 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 1073741824 Jul 08 03:43:43 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9290e07b-32f4-4ac7-be8b-17d1620f5c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63464a73-00a7-407e-80da-68c9201252c2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82789fa4-83ca-44e6-bcae-759fe7718453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:43 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume volume-63464a73-00a7-407e-80da-68c9201252c2 (63464a73-00a7-407e-80da-68c9201252c2): created successfully Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82789fa4-83ca-44e6-bcae-759fe7718453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (73f3f887-2265-4ea7-a7d2-851f923aae23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f323de14-d055-4840-a943-4c04c5d80f69 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created volume successfully. Jul 08 03:43:44 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 1073741824" returned: 0 in 1.039s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:44 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 Jul 08 03:43:44 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:44 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9" returned: 0 in 0.661s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.888s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538384569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cee39f-20f4-467c-9f27-50f38c9712f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:42Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Creating volume f7cee39f-20f4-467c-9f27-50f38c9712f3 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:44 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f429484e-f745-4d0e-b1dd-456cdd05dbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:44 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 1073741824 Jul 08 03:43:44 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930dd728-c46c-48d9-a605-2bd50f8106c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:44 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 (126eb6c9-6674-40de-bd8f-05a8289e2ac9): created successfully Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930dd728-c46c-48d9-a605-2bd50f8106c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (05c19781-7085-43e5-ae1f-33b10c9645f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d7907075-1b66-4f65-9861-61eed5fdcdd7 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created volume successfully. Jul 08 03:43:45 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 1073741824" returned: 0 in 0.839s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:45 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 Jul 08 03:43:45 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:46 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3" returned: 0 in 0.683s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.858s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558569027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad2bff6-d5fe-4be9-bf48-73b60d040727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:42Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Creating volume 2ad2bff6-d5fe-4be9-bf48-73b60d040727 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:46 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994511cd-a41a-494a-a513-f45a09d98737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cee39f-20f4-467c-9f27-50f38c9712f3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67250869-ddec-4110-b10f-5ea6cbcb7ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:46 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 1073741824 Jul 08 03:43:46 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:46 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 (f7cee39f-20f4-467c-9f27-50f38c9712f3): created successfully Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67250869-ddec-4110-b10f-5ea6cbcb7ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (93f0add6-9667-4173-b950-b5e3a11783ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7e5c556d-3f6b-416f-bb66-0a9ca83cdf04 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created volume successfully. Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:47 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:47 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Flow 'volume_create_manager' (128f40ed-7b57-4c4b-b117-c25e6e485be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a7632f-fa5c-423d-9c8f-9d40910505c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a7632f-fa5c-423d-9c8f-9d40910505c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-842657938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dbc751-33df-4a42-a783-154b38f55eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ba053986247f9b878868003602fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:47Z,use_quota=True,user_id='cfcecc0b7eb74cdba033709a4c12f8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12aeeb3b-637d-42d1-bc32-b8011f35fbad),volume_type_id=12aeeb3b-637d-42d1-bc32-b8011f35fbad)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a18d856-9fba-4651-9bd2-60190c951ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a18d856-9fba-4651-9bd2-60190c951ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7272b823-8c34-4283-a7af-187c9f87d550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7272b823-8c34-4283-a7af-187c9f87d550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12dbc751-33df-4a42-a783-154b38f55eea', 'volume_name': 'volume-12dbc751-33df-4a42-a783-154b38f55eea', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b850d6a3-ee37-449e-9994-3fbe9dd8dcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b850d6a3-ee37-449e-9994-3fbe9dd8dcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5a10f8-e5a2-441e-bdba-060a56277626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Volume 12dbc751-33df-4a42-a783-154b38f55eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12dbc751-33df-4a42-a783-154b38f55eea', 'volume_size': 1} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:47 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 1073741824" returned: 0 in 1.043s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:47 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 Jul 08 03:43:47 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Flow 'volume_create_manager' (7cce4de8-de05-4161-8d81-db3f690387d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7326e1d-8de6-41cf-a352-805d6e91512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7326e1d-8de6-41cf-a352-805d6e91512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2051863420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30348984-7513-490f-8869-f6d05e5cd5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ba053986247f9b878868003602fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:48Z,use_quota=True,user_id='cfcecc0b7eb74cdba033709a4c12f8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c97b02c-2d03-437c-b9ae-81a9de96b9ff),volume_type_id=2c97b02c-2d03-437c-b9ae-81a9de96b9ff)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b3d7f3-3172-4afe-870a-a6b4275808e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b3d7f3-3172-4afe-870a-a6b4275808e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c876d3-de9e-4ff1-a7fd-da73a1ec6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c876d3-de9e-4ff1-a7fd-da73a1ec6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30348984-7513-490f-8869-f6d05e5cd5db', 'volume_name': 'volume-30348984-7513-490f-8869-f6d05e5cd5db', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0823e26-236b-41c4-958e-f241b6830c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0823e26-236b-41c4-958e-f241b6830c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8d6e1b-155e-4260-be79-eac9934ba745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:47 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Volume 30348984-7513-490f-8869-f6d05e5cd5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30348984-7513-490f-8869-f6d05e5cd5db', 'volume_size': 1} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:47 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.909s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:43:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:43:48 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727" returned: 0 in 0.726s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.164s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891319291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46103b09-9060-4ed6-b03a-beee6a49f366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a1857a0d904a17930ce9972cbf147f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:43Z,use_quota=True,user_id='be791a6e6ad7458ca86cac43c27bb9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Creating volume 46103b09-9060-4ed6-b03a-beee6a49f366 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:48 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a23c3f-e88c-4a76-8a7e-fab46300dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f387a135-4949-4a45-9f16-1cc6037f9ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:48 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 1073741824 Jul 08 03:43:48 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 (2ad2bff6-d5fe-4be9-bf48-73b60d040727): created successfully Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f387a135-4949-4a45-9f16-1cc6037f9ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (4a02d15f-d540-4fe8-b418-010b4ae7af38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Flow 'volume_create_manager' (ae61634c-06ad-42fb-bf39-94f0736fea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c6d8b0-cf4d-4e43-ae63-1447f4053ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1e18c64d-4e95-4379-899e-67ea44cfc2f3 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created volume successfully. Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c6d8b0-cf4d-4e43-ae63-1447f4053ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1893682529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03efea3f-5183-483b-8122-9a5e811f2a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ba053986247f9b878868003602fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:48Z,use_quota=True,user_id='cfcecc0b7eb74cdba033709a4c12f8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77308eeb-0e25-4edb-b137-a1c922acd73b),volume_type_id=77308eeb-0e25-4edb-b137-a1c922acd73b)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180de175-7794-444c-b965-26e67c25d3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180de175-7794-444c-b965-26e67c25d3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbc1ea5-43b1-4695-8510-fade319587e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbc1ea5-43b1-4695-8510-fade319587e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03efea3f-5183-483b-8122-9a5e811f2a30', 'volume_name': 'volume-03efea3f-5183-483b-8122-9a5e811f2a30', 'volume_size': 1, 'image_id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--10172885', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '798ba053986247f9b878868003602fef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'created_at': datetime.datetime(2026, 7, 8, 1, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 43, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0/file', 'properties': {}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f1f48-f7f3-4916-a2e6-20f3c44f07ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f1f48-f7f3-4916-a2e6-20f3c44f07ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e153ddf-60db-4da1-9f4f-016951f4048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Volume 03efea3f-5183-483b-8122-9a5e811f2a30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03efea3f-5183-483b-8122-9a5e811f2a30', 'volume_size': 1, 'image_id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--10172885', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '798ba053986247f9b878868003602fef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'created_at': datetime.datetime(2026, 7, 8, 1, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 43, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0/file', 'properties': {}}, 'image_service': } Jul 08 03:43:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Trying to clone 03efea3f-5183-483b-8122-9a5e811f2a30 from image f311be48-d8b1-456c-9c74-1c78e6ceb9a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:43:49 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 1073741824" returned: 0 in 0.905s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:49 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 Jul 08 03:43:49 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:49 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366" returned: 0 in 0.701s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-842657938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dbc751-33df-4a42-a783-154b38f55eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ba053986247f9b878868003602fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:47Z,use_quota=True,user_id='cfcecc0b7eb74cdba033709a4c12f8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12aeeb3b-637d-42d1-bc32-b8011f35fbad),volume_type_id=12aeeb3b-637d-42d1-bc32-b8011f35fbad)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Creating volume 12dbc751-33df-4a42-a783-154b38f55eea {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:49 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:49 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea 1073741824 Jul 08 03:43:49 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb0fcf1-3df0-4ce2-8c5f-91941c5f3da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46103b09-9060-4ed6-b03a-beee6a49f366', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a5bd49-6fc1-4354-a3fc-2e1599ee21e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:49 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Volume volume-46103b09-9060-4ed6-b03a-beee6a49f366 (46103b09-9060-4ed6-b03a-beee6a49f366): created successfully Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a5bd49-6fc1-4354-a3fc-2e1599ee21e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Flow 'volume_create_manager' (4b97ff20-ccfd-48db-98db-c01196ba09d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:50 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0d0e9779-d8c9-4226-bac3-5680f013fe1f tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created volume successfully. Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-46103b09-9060-4ed6-b03a-beee6a49f366-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-46103b09-9060-4ed6-b03a-beee6a49f366-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-quobyte-46103b09-9060-4ed6-b03a-beee6a49f366" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:50 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea 1073741824" returned: 0 in 0.880s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-46103b09-9060-4ed6-b03a-beee6a49f366" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a468d3c3-9475-4a4b-9096-804c6887e78a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:50 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea Jul 08 03:43:50 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:50 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 Jul 08 03:43:50 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:51 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.748s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2051863420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30348984-7513-490f-8869-f6d05e5cd5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ba053986247f9b878868003602fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:48Z,use_quota=True,user_id='cfcecc0b7eb74cdba033709a4c12f8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c97b02c-2d03-437c-b9ae-81a9de96b9ff),volume_type_id=2c97b02c-2d03-437c-b9ae-81a9de96b9ff)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Creating volume 30348984-7513-490f-8869-f6d05e5cd5db {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:51 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:51 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:51 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db 1073741824 Jul 08 03:43:51 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:51 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366 Jul 08 03:43:51 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5a10f8-e5a2-441e-bdba-060a56277626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12dbc751-33df-4a42-a783-154b38f55eea', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75d51e-47ac-4943-8543-b9b7023c303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:51 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Volume volume-12dbc751-33df-4a42-a783-154b38f55eea (12dbc751-33df-4a42-a783-154b38f55eea): created successfully Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75d51e-47ac-4943-8543-b9b7023c303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Flow 'volume_create_manager' (128f40ed-7b57-4c4b-b117-c25e6e485be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-cde4a548-7a95-42b3-be0e-2f7b039225ec tempest-TestInstancesWithCinderVolumes-852146935 None] Created volume successfully. Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD, size 20.69 MB, duration 3.45 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:43:52 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Image download 20.69 MB at 5.99 MB/s Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[07641c7c-293f-4e8e-afc1-d591b16d0e18]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:52 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-46103b09-9060-4ed6-b03a-beee6a49f366" returned: 0 in 0.686s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-46103b09-9060-4ed6-b03a-beee6a49f366" released by "delete_volume" :: held 1.540s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:52 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD Jul 08 03:43:52 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created reservations ['85b83112-3acf-4649-a2bc-bee6d95a4126', '0b5bbb47-df52-4b83-8c60-176ee35545e9', 'ef73d993-4230-42e8-af25-16171741a042', 'c2547e7d-5cae-4e3a-9e87-260eef9336a6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:52 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:52 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:52 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db 1073741824" returned: 0 in 0.948s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:52 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db Jul 08 03:43:52 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-2ad2bff6-d5fe-4be9-bf48-73b60d040727-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-2ad2bff6-d5fe-4be9-bf48-73b60d040727-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:53 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Temporary image f311be48-d8b1-456c-9c74-1c78e6ceb9a0 is fetched for user cfcecc0b7eb74cdba033709a4c12f8d0. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-quobyte-2ad2bff6-d5fe-4be9-bf48-73b60d040727" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-2ad2bff6-d5fe-4be9-bf48-73b60d040727" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a485b1f9-7463-489c-a15c-651f40913bb7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:53 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfcd92a-2acf-454b-91d7-063d5dcbe815]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.743s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Deleted volume successfully. Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d720d88a-1994-4e5e-85c7-6e1693f2cb37 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-46103b09-9060-4ed6-b03a-beee6a49f366-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:53 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 Jul 08 03:43:53 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:53 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD Jul 08 03:43:53 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:53 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db" returned: 0 in 0.745s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8d6e1b-155e-4260-be79-eac9934ba745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30348984-7513-490f-8869-f6d05e5cd5db', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8eca5a-ff1a-4e6d-98c7-54cbe196156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:43:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Volume volume-30348984-7513-490f-8869-f6d05e5cd5db (30348984-7513-490f-8869-f6d05e5cd5db): created successfully Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8eca5a-ff1a-4e6d-98c7-54cbe196156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Flow 'volume_create_manager' (7cce4de8-de05-4161-8d81-db3f690387d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:43:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-52d9ee12-9f8b-4ec5-8e14-8b1f0d7a2dca tempest-TestInstancesWithCinderVolumes-852146935 None] Created volume successfully. Jul 08 03:43:53 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1893682529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03efea3f-5183-483b-8122-9a5e811f2a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ba053986247f9b878868003602fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:43:48Z,use_quota=True,user_id='cfcecc0b7eb74cdba033709a4c12f8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77308eeb-0e25-4edb-b137-a1c922acd73b),volume_type_id=77308eeb-0e25-4edb-b137-a1c922acd73b)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Creating volume 03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:43:53 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:43:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:54 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727" returned: 0 in 0.805s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:54 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 1073741824 Jul 08 03:43:54 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:54 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727 Jul 08 03:43:54 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:54 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2ad2bff6-d5fe-4be9-bf48-73b60d040727" returned: 0 in 0.661s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-2ad2bff6-d5fe-4be9-bf48-73b60d040727" released by "delete_volume" :: held 1.520s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created reservations ['1da3f093-2a83-4b26-9b9e-a721cd6b1c1f', '6a2d55d5-0a79-488d-9de9-92428f65c6be', 'e87e9d33-a667-4860-99ec-f3f36c71bcea', '2267046a-42b5-483f-83f4-7cde8a3b93fe'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:54 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:54 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:54 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 1073741824" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:54 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:43:54 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-f7cee39f-20f4-467c-9f27-50f38c9712f3-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-f7cee39f-20f4-467c-9f27-50f38c9712f3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-quobyte-f7cee39f-20f4-467c-9f27-50f38c9712f3" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-f7cee39f-20f4-467c-9f27-50f38c9712f3" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01fe406-dcbe-4af5-a053-2656edacdab7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:55 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.687s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Deleted volume successfully. Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b86574e0-8c0a-442b-9094-9079cff85f7e tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-2ad2bff6-d5fe-4be9-bf48-73b60d040727-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:55 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 0 in 0.687s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Attempting download of f311be48-d8b1-456c-9c74-1c78e6ceb9a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'metadata': {}}])) to volume 03efea3f-5183-483b-8122-9a5e811f2a30. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:43:55 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 Jul 08 03:43:55 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc15fe22-2d00-4feb-8856-fdf026904fbe]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:55 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt Jul 08 03:43:55 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:56 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3" returned: 0 in 0.781s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:56 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3 Jul 08 03:43:56 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:56 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt" returned: 0 in 0.706s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:56 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt Jul 08 03:43:56 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:56 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f7cee39f-20f4-467c-9f27-50f38c9712f3" returned: 0 in 0.656s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-f7cee39f-20f4-467c-9f27-50f38c9712f3" released by "delete_volume" :: held 1.489s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created reservations ['13186a4e-62ad-4c49-9227-2cf9df65fa9a', '812b6874-571c-45ac-a4ab-8dad5f4b3a80', '97005c77-aa2c-4135-b834-3b2828b46f18', '61ea01a0-0339-45e5-8814-f15582eea6c3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:57 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:57 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:57 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt" returned: 1 in 0.742s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_p3fdwslt' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee24272-935b-4374-940c-c3543674b4c1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:57 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD Jul 08 03:43:57 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-126eb6c9-6674-40de-bd8f-05a8289e2ac9-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-126eb6c9-6674-40de-bd8f-05a8289e2ac9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-quobyte-126eb6c9-6674-40de-bd8f-05a8289e2ac9" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-126eb6c9-6674-40de-bd8f-05a8289e2ac9" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6a24db-9e4b-4b1e-a394-f0cebdc90c43]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:57 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.691s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:43:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Deleted volume successfully. Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-692be06f-dfa5-49a4-b34b-335f939bc438 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-f7cee39f-20f4-467c-9f27-50f38c9712f3-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:57 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] f311be48-d8b1-456c-9c74-1c78e6ceb9a0 was qcow2, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:43:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:57 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 Jul 08 03:43:57 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:57 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:43:57 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:58 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9" returned: 0 in 0.796s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:58 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9 Jul 08 03:43:58 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:59 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-126eb6c9-6674-40de-bd8f-05a8289e2ac9" returned: 0 in 0.649s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-126eb6c9-6674-40de-bd8f-05a8289e2ac9" released by "delete_volume" :: held 1.496s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created reservations ['842af9ba-fafc-46d1-bc61-6e2176f01cc2', '47f64e4a-e14c-487e-adad-b3745a43b81f', '4983d853-b428-4bca-8ec2-5d5c01c8df8c', 'b22566ed-45a7-45aa-86c7-26dddb8f912e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:59 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:43:59 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:59 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 0 in 1.805s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f311be48-d8b1-456c-9c74-1c78e6ceb9a0_fy05ofrndevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:43:59 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Converted 112.00 MB image at 61.99 MB/s Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:59 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 1G Jul 08 03:43:59 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-63464a73-00a7-407e-80da-68c9201252c2-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-63464a73-00a7-407e-80da-68c9201252c2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-quobyte-63464a73-00a7-407e-80da-68c9201252c2" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-63464a73-00a7-407e-80da-68c9201252c2" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c191337-7710-4e69-95d2-f5c1ddebe29f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:43:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:43:59 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.734s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:00 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Deleted volume successfully. Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9f67800a-2668-4c57-8168-9259ec3806d1 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-126eb6c9-6674-40de-bd8f-05a8289e2ac9-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:00 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 Jul 08 03:44:00 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:00 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 1G" returned: 0 in 0.714s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4350ddad-3d5a-4360-8c46-24c6676a710a]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:00 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:44:00 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:00 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2" returned: 0 in 0.762s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:00 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2 Jul 08 03:44:00 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:01 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 0 in 0.746s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:01 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:44:01 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:01 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-63464a73-00a7-407e-80da-68c9201252c2" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-63464a73-00a7-407e-80da-68c9201252c2" released by "delete_volume" :: held 1.458s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created reservations ['71c941f0-c020-40e5-8505-70ed0d16de87', '4262585f-a5fe-4625-aa54-6e5c229842aa', '65c30bf9-7e23-4b27-ac09-33361ccff185', '2d159528-503b-46f5-b64c-6424bdc1a41d'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:01 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:44:01 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:01 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 1 in 0.753s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Downloaded image f311be48-d8b1-456c-9c74-1c78e6ceb9a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'metadata': {}}])) to volume 03efea3f-5183-483b-8122-9a5e811f2a30 successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Temporary image f311be48-d8b1-456c-9c74-1c78e6ceb9a0 for user cfcecc0b7eb74cdba033709a4c12f8d0 is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Marking volume 03efea3f-5183-483b-8122-9a5e811f2a30 as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Copying metadata from image f311be48-d8b1-456c-9c74-1c78e6ceb9a0 to 03efea3f-5183-483b-8122-9a5e811f2a30. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Creating volume glance metadata for volume 03efea3f-5183-483b-8122-9a5e811f2a30 backed by image f311be48-d8b1-456c-9c74-1c78e6ceb9a0 with: {'image_id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'image_name': 'tempest-scenario-img--10172885', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e153ddf-60db-4da1-9f4f-016951f4048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03efea3f-5183-483b-8122-9a5e811f2a30', 'volume_size': 1, 'image_id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--10172885', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '798ba053986247f9b878868003602fef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f311be48-d8b1-456c-9c74-1c78e6ceb9a0', 'created_at': datetime.datetime(2026, 7, 8, 1, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 43, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f311be48-d8b1-456c-9c74-1c78e6ceb9a0/file', 'properties': {}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68cd48cd-5ba9-4376-a0cf-dc9a76980a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Volume volume-03efea3f-5183-483b-8122-9a5e811f2a30 (03efea3f-5183-483b-8122-9a5e811f2a30): created successfully Jul 08 03:44:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68cd48cd-5ba9-4376-a0cf-dc9a76980a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Flow 'volume_create_manager' (ae61634c-06ad-42fb-bf39-94f0736fea6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-28db8c5d-8a51-4c5b-b7b5-4f9da182df08 tempest-TestInstancesWithCinderVolumes-852146935 None] Created volume successfully. Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-459c768f-acef-4754-9553-f2f1d3dbf545-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-459c768f-acef-4754-9553-f2f1d3dbf545-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "cinder-quobyte-459c768f-acef-4754-9553-f2f1d3dbf545" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:02 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-459c768f-acef-4754-9553-f2f1d3dbf545" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Deleted volume successfully. Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c08cd2-7f89-4cf3-9168-4d88f8bfd03a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c0b6cba8-b39e-4d13-a5dd-e0c298034e07 tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-63464a73-00a7-407e-80da-68c9201252c2-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:02 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 Jul 08 03:44:02 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:02 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545" returned: 0 in 0.782s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:03 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545 Jul 08 03:44:03 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:03 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-459c768f-acef-4754-9553-f2f1d3dbf545" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-quobyte-459c768f-acef-4754-9553-f2f1d3dbf545" released by "delete_volume" :: held 1.514s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Created reservations ['177e6da0-b3f1-4138-ba40-1e7f1732725d', '231406b0-95bc-4c28-bd91-a4514480d7d7', '1b4dda98-e712-49ad-a218-d73b77047756', 'd20356fc-7926-4779-b602-b0c4b4419511'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:03 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:44:03 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:04 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:04 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Deleted volume successfully. Jul 08 03:44:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9ebbfa2-8946-438e-9b7f-acaf7641891b tempest-CreateVolumesFromSourceVolumeTest-1303920397 None] Lock "cinder-459c768f-acef-4754-9553-f2f1d3dbf545-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Flow 'volume_create_manager' (948802fd-c183-4ef9-a0da-b49c78d87e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612f5ce3-acf5-4544-8be2-8de5fafd6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612f5ce3-acf5-4544-8be2-8de5fafd6192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1547424208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7033e8ee54314854a5622eab06b5cc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:07Z,use_quota=True,user_id='133572f7c8bf4de48f5176f99ff2b36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189370c9-44cf-470c-af8a-ce4f21c9bb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189370c9-44cf-470c-af8a-ce4f21c9bb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512857e3-3fe3-4dcc-bd11-d7675b225943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512857e3-3fe3-4dcc-bd11-d7675b225943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1', 'volume_name': 'volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f25ce4e-0523-4c64-8781-7de0b6c52704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f25ce4e-0523-4c64-8781-7de0b6c52704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054919ae-2399-4d97-9bf3-547f3a6c4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Volume edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1', 'volume_size': 1} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1547424208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7033e8ee54314854a5622eab06b5cc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:07Z,use_quota=True,user_id='133572f7c8bf4de48f5176f99ff2b36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Creating volume edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:44:07 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:07 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 1073741824 Jul 08 03:44:07 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:07 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 1073741824" returned: 0 in 0.801s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:08 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:08 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:08 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054919ae-2399-4d97-9bf3-547f3a6c4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aca15e-0dfa-4e3e-8abe-43e0e1be32a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:08 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Volume volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 (edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1): created successfully Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aca15e-0dfa-4e3e-8abe-43e0e1be32a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Flow 'volume_create_manager' (948802fd-c183-4ef9-a0da-b49c78d87e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c829d8f4-8a9c-4d1f-a08c-626598246f58 tempest-VolumeDependencyTests-1573530968 None] Created volume successfully. Jul 08 03:44:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Creating offline snapshot ef388bd4-8324-47f8-a88c-f1454e9a827f of volume edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:44:09 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[031e88eb-792a-4ab7-80e6-dee2bae1d9ba]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:09 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:09 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:10 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.835s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:10 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f 1G Jul 08 03:44:10 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:11 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f 1G" returned: 0 in 0.935s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:11 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f Jul 08 03:44:11 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:11 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f" returned: 0 in 0.713s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:11 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f is being set with open permissions: ugo+rw Jul 08 03:44:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:11 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f Jul 08 03:44:11 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:12 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f" returned: 0 in 0.630s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:12 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info Jul 08 03:44:12 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:13 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info" returned: 0 in 0.641s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:13 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info is being set with open permissions: ugo+rw Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:13 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info Jul 08 03:44:13 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:13 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.info" returned: 0 in 0.644s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.481s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.761s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3f33b4e2-bf87-4013-aa2e-bdb17d232f20 tempest-VolumeDependencyTests-1573530968 None] Create snapshot completed successfully Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddafb82-36e6-41e4-9d9e-e0f881fa9c3a]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:13 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:44:13 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:14 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 0 in 0.755s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:14 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:44:14 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Flow 'volume_create_manager' (52d6bf09-61a5-4601-951a-9fb8937dad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d5b8eb-a716-4d2c-b640-5d94de0700f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d5b8eb-a716-4d2c-b640-5d94de0700f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1191748543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7d51cb-8f08-4bb4-8d28-6f6458516695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7033e8ee54314854a5622eab06b5cc9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef388bd4-8324-47f8-a88c-f1454e9a827f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:15Z,use_quota=True,user_id='133572f7c8bf4de48f5176f99ff2b36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd60a66d-810b-44c9-9de4-7173ba0a6817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd60a66d-810b-44c9-9de4-7173ba0a6817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188e66e-7623-4879-a1f2-2a4b15d44844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188e66e-7623-4879-a1f2-2a4b15d44844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad7d51cb-8f08-4bb4-8d28-6f6458516695', 'volume_name': 'volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695', 'volume_size': 1, 'snapshot_id': 'ef388bd4-8324-47f8-a88c-f1454e9a827f'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa57c922-12ca-43d5-b929-ca2542ce403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa57c922-12ca-43d5-b929-ca2542ce403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7126a8cf-1df5-4775-9f13-8224d7aee5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Volume ad7d51cb-8f08-4bb4-8d28-6f6458516695: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695', 'volume_size': 1, 'snapshot_id': 'ef388bd4-8324-47f8-a88c-f1454e9a827f'} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:15 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 1 in 0.752s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.551s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.206s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-quobyte-ef388bd4-8324-47f8-a88c-f1454e9a827f-ad7d51cb-8f08-4bb4-8d28-6f6458516695" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ef388bd4-8324-47f8-a88c-f1454e9a827f-ad7d51cb-8f08-4bb4-8d28-6f6458516695" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Creating volume ad7d51cb-8f08-4bb4-8d28-6f6458516695 from snapshot ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-quobyte-ad7d51cb-8f08-4bb4-8d28-6f6458516695" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ad7d51cb-8f08-4bb4-8d28-6f6458516695" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] snapshot: ef388bd4-8324-47f8-a88c-f1454e9a827f, volume: ad7d51cb-8f08-4bb4-8d28-6f6458516695, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-03efea3f-5183-483b-8122-9a5e811f2a30', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f452b11-5a0e-4bdf-b534-8de5203ca992', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e740f18-37d0-4af1-890b-3e45c5c1af21]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-9ad8b765-6bd7-4231-8cfd-81b9ecd52ed7 req-d46de2de-f795-4cc2-8500-05c971330c90 tempest-TestInstancesWithCinderVolumes-852146935 None] attachment_update completed successfully. Jul 08 03:44:15 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f Jul 08 03:44:15 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:16 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f" returned: 0 in 0.760s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:44:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:44:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:44:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e3a558-d45b-43f6-b854-645c75b5f056]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:16 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:16 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:17 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.754s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:17 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:44:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:17 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 Jul 08 03:44:17 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:22 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695" returned: 0 in 5.594s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c09006a-f18e-4655-a233-8e0b8dd220db]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:22 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:22 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:23 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.949s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:23 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:44:23 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Converted 1024.00 MB image at 183.01 MB/s Jul 08 03:44:23 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 is being set with open permissions: ugo+rw Jul 08 03:44:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:23 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 Jul 08 03:44:23 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:24 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695" returned: 0 in 0.713s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ad7d51cb-8f08-4bb4-8d28-6f6458516695" released by "_copy_volume_from_snapshot" :: held 8.882s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ef388bd4-8324-47f8-a88c-f1454e9a827f-ad7d51cb-8f08-4bb4-8d28-6f6458516695" released by "_create_volume_from_snapshot" :: held 8.914s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.942s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7126a8cf-1df5-4775-9f13-8224d7aee5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695', 'volume_size': 1, 'snapshot_id': 'ef388bd4-8324-47f8-a88c-f1454e9a827f'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4220a2-b2ea-40c8-9e78-aa5623e44c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:24 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Volume volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 (ad7d51cb-8f08-4bb4-8d28-6f6458516695): created successfully Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4220a2-b2ea-40c8-9e78-aa5623e44c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Flow 'volume_create_manager' (52d6bf09-61a5-4601-951a-9fb8937dad26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-072d29e8-6bcf-4223-a9b5-e90f56f7db5b tempest-VolumeDependencyTests-1573530968 None] Created volume successfully. Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-ef388bd4-8324-47f8-a88c-f1454e9a827f-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-ef388bd4-8324-47f8-a88c-f1454e9a827f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-quobyte-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-quobyte-ef388bd4-8324-47f8-a88c-f1454e9a827f" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ef388bd4-8324-47f8-a88c-f1454e9a827f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Deleting offline snapshot ef388bd4-8324-47f8-a88c-f1454e9a827f of volume edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] snapshot_file for this snap is: volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe99526-2ab5-49f0-a5b1-bb3d9f121c9f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:25 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f Jul 08 03:44:25 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:25 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f" returned: 0 in 0.855s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:44:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[012056c4-b6db-4175-b4e1-c3417c396e79]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:26 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:26 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:26 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.889s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:26 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f Jul 08 03:44:26 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:27 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f" returned: 0 in 0.864s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:27 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f Jul 08 03:44:27 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:28 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1.ef388bd4-8324-47f8-a88c-f1454e9a827f" returned: 0 in 0.750s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ef388bd4-8324-47f8-a88c-f1454e9a827f" released by "_delete_snapshot" :: held 3.472s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" released by "delete_snapshot" :: held 3.506s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:28 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Created reservations ['1d97ab67-b07c-4c2a-b22d-c61a2a55b9dc', '19d6a53a-2e0b-46e6-9ca4-489874139e01', 'cba962c4-693c-45f2-9ebf-0369a7bc35af', '584c2c6a-9a92-47f7-b3fc-e13ce36fafa8'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:44:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Delete snapshot completed successfully. Jul 08 03:44:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-177b5c96-afb1-429f-817c-a5eb7155e155 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-ef388bd4-8324-47f8-a88c-f1454e9a827f-delete_snapshot" released by "delete_snapshot" :: held 3.689s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-quobyte-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:29 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee5ed4-03f9-47a8-912a-b49d9c53897d]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:29 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:29 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:30 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.835s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:30 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1 Jul 08 03:44:30 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:30 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1" released by "delete_volume" :: held 1.581s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Created reservations ['6b7563f5-4f00-475e-8e8b-f4ca7b8abc83', 'ece81a84-bf9d-4b3a-8d7a-38e0c94671e8', 'e71b27cd-f153-4f36-b69c-d30720c6079c', '38fdb451-5988-42d9-865e-2352ccc41837'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:31 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:44:31 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-ad7d51cb-8f08-4bb4-8d28-6f6458516695-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-ad7d51cb-8f08-4bb4-8d28-6f6458516695-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "cinder-quobyte-ad7d51cb-8f08-4bb4-8d28-6f6458516695" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ad7d51cb-8f08-4bb4-8d28-6f6458516695" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b46ee5-8cdc-482f-9f26-4162cb6d50c8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:31 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 Jul 08 03:44:31 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:31 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.745s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Deleted volume successfully. Jul 08 03:44:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8e30ce6-82b1-4120-9f39-e4d1b505977a tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-edd5e95f-4de6-4938-a7ad-bb4c8c8be2e1-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:32 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:32 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695 Jul 08 03:44:32 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:33 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-ad7d51cb-8f08-4bb4-8d28-6f6458516695" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-quobyte-ad7d51cb-8f08-4bb4-8d28-6f6458516695" released by "delete_volume" :: held 1.485s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Created reservations ['30ae2857-d2bf-43ae-bd8d-173f9e158b9c', 'f48862d6-c8f8-45a7-9971-877125762abf', '52e951e9-c641-4374-aa2a-5e90562a008e', '2a8f6475-2c33-4258-ac46-a4ecf9226434'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:33 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:44:33 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:33 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.665s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:33 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:33 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Deleted volume successfully. Jul 08 03:44:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6bbcd9f7-8c09-4d8f-bba5-718379c4ad31 tempest-VolumeDependencyTests-1573530968 None] Lock "cinder-ad7d51cb-8f08-4bb4-8d28-6f6458516695-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=90,cinder:UPDATE=107,cinder:INSERT=26,cinder:DELETE=10 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=107,cinder:INSERT=30,cinder:DELETE=10,cinder:SELECT=77 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Flow 'volume_create_manager' (345e66e8-271f-4fe3-b9bd-09a720794729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbe1d2f-a6d5-4a94-8dab-4900ac99219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbe1d2f-a6d5-4a94-8dab-4900ac99219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d28251-6eb9-445e-979c-25e38e220b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b119f7114b424db9d2fe37dfb47c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:39Z,use_quota=True,user_id='eb40a8c1141443aa802de24eee497447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd9c1e-97b5-483b-b6a0-8503d7b040b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd9c1e-97b5-483b-b6a0-8503d7b040b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f69b9c-5087-4f2d-977f-571613824a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f69b9c-5087-4f2d-977f-571613824a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79d28251-6eb9-445e-979c-25e38e220b88', 'volume_name': 'volume-79d28251-6eb9-445e-979c-25e38e220b88', 'volume_size': 1, 'image_id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c00bbe35-4483-436d-8e81-72c0f2b2756b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c343fa538e9b52cfc1510b64659ce9e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4b119f7114b424db9d2fe37dfb47c31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fe19b77fce899012b56d28b6afabeb7030c9cb859e3169c67c65870c1699b522e575346162bffe67ffc2ce5080c081017264f7d57a05400c9ddbe6686071cbd', 'id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'created_at': datetime.datetime(2026, 7, 8, 1, 44, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 44, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c00bbe35-4483-436d-8e81-72c0f2b2756b/file', 'properties': {}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b78178d-852d-42a7-a79c-d5f9e32a3434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b78178d-852d-42a7-a79c-d5f9e32a3434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc87b757-edc0-4a1f-924c-073e67309d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Volume 79d28251-6eb9-445e-979c-25e38e220b88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79d28251-6eb9-445e-979c-25e38e220b88', 'volume_size': 1, 'image_id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c00bbe35-4483-436d-8e81-72c0f2b2756b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c343fa538e9b52cfc1510b64659ce9e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4b119f7114b424db9d2fe37dfb47c31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fe19b77fce899012b56d28b6afabeb7030c9cb859e3169c67c65870c1699b522e575346162bffe67ffc2ce5080c081017264f7d57a05400c9ddbe6686071cbd', 'id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'created_at': datetime.datetime(2026, 7, 8, 1, 44, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 44, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c00bbe35-4483-436d-8e81-72c0f2b2756b/file', 'properties': {}}, 'image_service': } Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Trying to clone 79d28251-6eb9-445e-979c-25e38e220b88 from image c00bbe35-4483-436d-8e81-72c0f2b2756b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c00bbe35-4483-436d-8e81-72c0f2b2756b', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:44:39 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Image download 0.00 MB at 0.00 MB/s Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e2a68-8baf-4af4-b40c-92ef96d3f075]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:39 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD Jul 08 03:44:39 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:40 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:40 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD Jul 08 03:44:40 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:40 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD" returned: 1 in 0.706s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Temporary image c00bbe35-4483-436d-8e81-72c0f2b2756b is fetched for user eb40a8c1141443aa802de24eee497447. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[713fee08-2d89-42be-ba46-59d5bc7f3b82]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:41 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD Jul 08 03:44:41 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:41 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:41 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD Jul 08 03:44:41 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:42 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD" returned: 1 in 0.721s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d28251-6eb9-445e-979c-25e38e220b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b119f7114b424db9d2fe37dfb47c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:39Z,use_quota=True,user_id='eb40a8c1141443aa802de24eee497447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Creating volume 79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:44:42 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:44:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:42 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 1073741824 Jul 08 03:44:42 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:43 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 1073741824" returned: 0 in 0.812s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:43 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:43 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:43 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Attempting download of c00bbe35-4483-436d-8e81-72c0f2b2756b ((None, [{'url': 'file:///opt/stack/data/glance/images/c00bbe35-4483-436d-8e81-72c0f2b2756b', 'metadata': {}}])) to volume 79d28251-6eb9-445e-979c-25e38e220b88. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6743ab-3a5f-4bf0-9f6f-d97f757de60f]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:44 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu Jul 08 03:44:44 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:44 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu" returned: 0 in 0.765s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:44 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu Jul 08 03:44:44 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:45 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu" returned: 1 in 0.757s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c00bbe35-4483-436d-8e81-72c0f2b2756b_nignl5qu' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51afecf-399a-434f-9dbd-ba63bcd0192e]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:45 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD Jul 08 03:44:45 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:46 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:46 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD Jul 08 03:44:46 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:46 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD" returned: 1 in 0.707s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] c00bbe35-4483-436d-8e81-72c0f2b2756b was raw, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:46 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:46 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:47 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:44:47 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:47 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:47 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 0 in 0.727s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c00bbe35-4483-436d-8e81-72c0f2b2756b_epx7ivh7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:44:47 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:44:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:44:47 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 1G Jul 08 03:44:47 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:48 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 1G" returned: 0 in 0.666s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[704d5f59-7c10-41bd-b617-3e94890dd145]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:48 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:48 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:49 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:49 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:49 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:49 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 1 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Downloaded image c00bbe35-4483-436d-8e81-72c0f2b2756b ((None, [{'url': 'file:///opt/stack/data/glance/images/c00bbe35-4483-436d-8e81-72c0f2b2756b', 'metadata': {}}])) to volume 79d28251-6eb9-445e-979c-25e38e220b88 successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Temporary image c00bbe35-4483-436d-8e81-72c0f2b2756b for user eb40a8c1141443aa802de24eee497447 is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Marking volume 79d28251-6eb9-445e-979c-25e38e220b88 as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Copying metadata from image c00bbe35-4483-436d-8e81-72c0f2b2756b to 79d28251-6eb9-445e-979c-25e38e220b88. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Creating volume glance metadata for volume 79d28251-6eb9-445e-979c-25e38e220b88 backed by image c00bbe35-4483-436d-8e81-72c0f2b2756b with: {'image_id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c343fa538e9b52cfc1510b64659ce9e2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc87b757-edc0-4a1f-924c-073e67309d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d28251-6eb9-445e-979c-25e38e220b88', 'volume_size': 1, 'image_id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c00bbe35-4483-436d-8e81-72c0f2b2756b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c343fa538e9b52cfc1510b64659ce9e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4b119f7114b424db9d2fe37dfb47c31', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9fe19b77fce899012b56d28b6afabeb7030c9cb859e3169c67c65870c1699b522e575346162bffe67ffc2ce5080c081017264f7d57a05400c9ddbe6686071cbd', 'id': 'c00bbe35-4483-436d-8e81-72c0f2b2756b', 'created_at': datetime.datetime(2026, 7, 8, 1, 44, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 44, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c00bbe35-4483-436d-8e81-72c0f2b2756b/file', 'properties': {}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91c0514-8299-40dd-a73d-82c0b7db1e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:49 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Volume volume-79d28251-6eb9-445e-979c-25e38e220b88 (79d28251-6eb9-445e-979c-25e38e220b88): created successfully Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91c0514-8299-40dd-a73d-82c0b7db1e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Flow 'volume_create_manager' (345e66e8-271f-4fe3-b9bd-09a720794729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4b5d03bc-0971-4bc0-b621-deccf16865f2 tempest-VolumeImageDependencyTests-1964022358 None] Created volume successfully. Jul 08 03:44:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Acquiring lock "cinder-79d28251-6eb9-445e-979c-25e38e220b88-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Lock "cinder-79d28251-6eb9-445e-979c-25e38e220b88-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Acquiring lock "cinder-quobyte-79d28251-6eb9-445e-979c-25e38e220b88" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:44:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Lock "cinder-quobyte-79d28251-6eb9-445e-979c-25e38e220b88" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:44:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ee321-40de-45fd-829a-210dd4e7b49b]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:50 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:50 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:51 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 0 in 0.733s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:51 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:51 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:52 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 1 in 0.757s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:44:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:52 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88 Jul 08 03:44:52 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:52 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-79d28251-6eb9-445e-979c-25e38e220b88" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Lock "cinder-quobyte-79d28251-6eb9-445e-979c-25e38e220b88" released by "delete_volume" :: held 2.191s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Created reservations ['43476f7b-4add-4f93-aabe-41ce9250cb16', '3727451f-ddd2-4023-b0a5-9e487f94f868', '54216f00-bafd-4190-aa2b-4b03510cb6d6', '4542ed6e-5df2-4647-82e0-504e6d8cfdbd'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:53 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:44:53 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3323f29c-c6d6-4994-af72-6e2384b67647]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:53 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea Jul 08 03:44:53 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:53 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.661s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:44:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Deleted volume successfully. Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-2fab46ad-6161-48cc-a6ca-0954cef94bed tempest-VolumeImageDependencyTests-1964022358 None] Lock "cinder-79d28251-6eb9-445e-979c-25e38e220b88-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:44:53 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea" returned: 0 in 0.770s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:54 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-12dbc751-33df-4a42-a783-154b38f55eea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50d76a88-fb80-4f71-8d21-695a97ba3141', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:44:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-45797e9f-5e96-402d-b539-cf70626f2112 req-908c40a5-a34a-455b-8ed1-430212847430 tempest-TestInstancesWithCinderVolumes-852146935 None] attachment_update completed successfully. Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Flow 'volume_create_manager' (3b5edf62-23ab-4493-910a-52a9141175ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac24dc2-607b-44e0-bb66-c141845f1c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac24dc2-607b-44e0-bb66-c141845f1c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dae3290-1909-495a-9b3c-03354bbcbd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f78ff30b764aa8bd69356299b4b278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:57Z,use_quota=True,user_id='e0eacc4e03c14bcfb4d8cdab21c5ac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8a3c88-471d-42a7-bfe8-46b0797ac23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8a3c88-471d-42a7-bfe8-46b0797ac23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27710bc-a66d-4d05-ac83-5f1d02e53b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27710bc-a66d-4d05-ac83-5f1d02e53b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dae3290-1909-495a-9b3c-03354bbcbd6c', 'volume_name': 'volume-1dae3290-1909-495a-9b3c-03354bbcbd6c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11094338-df17-400c-81ec-6ae2795b2284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11094338-df17-400c-81ec-6ae2795b2284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9217e1a-0645-4a11-8a08-9d488c9024de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Volume 1dae3290-1909-495a-9b3c-03354bbcbd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dae3290-1909-495a-9b3c-03354bbcbd6c', 'volume_size': 1} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dae3290-1909-495a-9b3c-03354bbcbd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f78ff30b764aa8bd69356299b4b278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:44:57Z,use_quota=True,user_id='e0eacc4e03c14bcfb4d8cdab21c5ac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Creating volume 1dae3290-1909-495a-9b3c-03354bbcbd6c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:44:57 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:57 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c 1073741824 Jul 08 03:44:57 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:57 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c 1073741824" returned: 0 in 0.790s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:57 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c Jul 08 03:44:57 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:44:58 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c" returned: 0 in 0.644s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9217e1a-0645-4a11-8a08-9d488c9024de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dae3290-1909-495a-9b3c-03354bbcbd6c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620fc51c-b35f-428b-971d-ac39b0a330f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:58 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Volume volume-1dae3290-1909-495a-9b3c-03354bbcbd6c (1dae3290-1909-495a-9b3c-03354bbcbd6c): created successfully Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620fc51c-b35f-428b-971d-ac39b0a330f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Flow 'volume_create_manager' (3b5edf62-23ab-4493-910a-52a9141175ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-15d1a1b7-45c6-418b-91db-f952e0eb8720 tempest-CinderUnicodeTest-1918363638 None] Created volume successfully. Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Flow 'volume_create_manager' (626c4b15-2585-43ad-a649-b6c2352cacbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38458188-e0fe-4aa9-b650-1743f781f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38458188-e0fe-4aa9-b650-1743f781f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916021992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cae914e-315d-4ed4-b3da-ca0ae28e9e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f78ff30b764aa8bd69356299b4b278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:45:00Z,use_quota=True,user_id='e0eacc4e03c14bcfb4d8cdab21c5ac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74053174-d546-4398-81c5-e5001e5f6ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74053174-d546-4398-81c5-e5001e5f6ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68592bb0-7bdc-40f4-a724-2e89f7840200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68592bb0-7bdc-40f4-a724-2e89f7840200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cae914e-315d-4ed4-b3da-ca0ae28e9e35', 'volume_name': 'volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94165e59-ae9f-4520-8be3-791bdd11f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94165e59-ae9f-4520-8be3-791bdd11f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f98f99-e131-4134-9919-aaa0717e225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:44:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Volume 4cae914e-315d-4ed4-b3da-ca0ae28e9e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35', 'volume_size': 1} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:44:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916021992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cae914e-315d-4ed4-b3da-ca0ae28e9e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f78ff30b764aa8bd69356299b4b278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:45:00Z,use_quota=True,user_id='e0eacc4e03c14bcfb4d8cdab21c5ac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Creating volume 4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:44:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:44:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:44:59 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 1073741824 Jul 08 03:44:59 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:00 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 1073741824" returned: 0 in 0.820s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:00 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 Jul 08 03:45:00 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:01 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f98f99-e131-4134-9919-aaa0717e225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0917062b-f7fe-41cd-a1df-62a88323bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Volume volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 (4cae914e-315d-4ed4-b3da-ca0ae28e9e35): created successfully Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0917062b-f7fe-41cd-a1df-62a88323bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Flow 'volume_create_manager' (626c4b15-2585-43ad-a649-b6c2352cacbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:45:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8c422809-af18-4c40-9f70-db03cf31cd25 tempest-CinderUnicodeTest-1918363638 None] Created volume successfully. Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ecef25-e369-40a4-b181-d6e8e3e4a238]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:01 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db Jul 08 03:45:01 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:02 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.445s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Creating offline snapshot 000651f9-0e68-4faa-aa0a-056945914069 of volume 4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9e82a-eda2-4c11-9da5-153c65649485]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-30348984-7513-490f-8869-f6d05e5cd5db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f5bc35e-0f3d-4f95-ae3c-79b97aeeff4e', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:45:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-3089f5be-06c8-46db-bb8a-b0cdd8532d49 req-04ba4f68-cd85-4326-8eb2-30c27a38f817 tempest-TestInstancesWithCinderVolumes-852146935 None] attachment_update completed successfully. Jul 08 03:45:02 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 Jul 08 03:45:02 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:03 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:03 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 1G Jul 08 03:45:03 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:03 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 1G" returned: 0 in 0.785s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:03 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 Jul 08 03:45:03 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:04 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069" returned: 0 in 0.675s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:04 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 is being set with open permissions: ugo+rw Jul 08 03:45:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:04 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 Jul 08 03:45:04 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:05 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:05 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info Jul 08 03:45:05 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:05 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:05 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info is being set with open permissions: ugo+rw Jul 08 03:45:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:05 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info Jul 08 03:45:05 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:06 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.info" returned: 0 in 0.671s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.316s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-41bc442e-101c-4cae-a22f-21efb8266314 tempest-CinderUnicodeTest-1918363638 None] Create snapshot completed successfully Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-000651f9-0e68-4faa-aa0a-056945914069-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-000651f9-0e68-4faa-aa0a-056945914069-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-quobyte-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-quobyte-000651f9-0e68-4faa-aa0a-056945914069" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-000651f9-0e68-4faa-aa0a-056945914069" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Deleting offline snapshot 000651f9-0e68-4faa-aa0a-056945914069 of volume 4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] snapshot_file for this snap is: volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15aaa3c-8ac1-485b-96f0-10ff4e571dbf]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:07 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 Jul 08 03:45:07 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:08 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069" returned: 0 in 0.780s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:45:08 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ad2d1-2cdd-4bd9-921d-f07a4b087346]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:08 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 Jul 08 03:45:08 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:08 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" returned: 0 in 0.831s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:08 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 Jul 08 03:45:08 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:09 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069" returned: 0 in 0.740s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:09 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069 Jul 08 03:45:09 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:10 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35.000651f9-0e68-4faa-aa0a-056945914069" returned: 0 in 0.641s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-000651f9-0e68-4faa-aa0a-056945914069" released by "_delete_snapshot" :: held 3.114s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" released by "delete_snapshot" :: held 3.140s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:10 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Created reservations ['4adf1e59-ab07-41a1-8642-4157a3aff91d', '8e53615f-3d38-45bb-95de-f76128534acc', '3f248570-303b-4a21-9e70-ac58773a4010', '5529d561-f3fb-4988-8708-5acc612df9a7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:10 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Delete snapshot completed successfully. Jul 08 03:45:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b69d51d9-6d1e-4615-b135-907d414a1237 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-000651f9-0e68-4faa-aa0a-056945914069-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:11 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-2589de5c-517a-4336-9fa2-6dd70da86ca2 req-0afa6861-5cb3-4440-b10e-59c0b75f1fa5 tempest-TestInstancesWithCinderVolumes-852146935 None] Terminate volume connection completed successfully. Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-2589de5c-517a-4336-9fa2-6dd70da86ca2 req-0afa6861-5cb3-4440-b10e-59c0b75f1fa5 tempest-TestInstancesWithCinderVolumes-852146935 None] Deleting attachment 50d76a88-fb80-4f71-8d21-695a97ba3141. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-4cae914e-315d-4ed4-b3da-ca0ae28e9e35-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-4cae914e-315d-4ed4-b3da-ca0ae28e9e35-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-quobyte-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521d1ae-d51f-4864-8a85-1b81a56a4028]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:11 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 Jul 08 03:45:11 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:12 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" returned: 0 in 0.757s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:12 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35 Jul 08 03:45:12 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:12 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" returned: 0 in 0.628s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-4cae914e-315d-4ed4-b3da-ca0ae28e9e35" released by "delete_volume" :: held 1.438s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Created reservations ['967e67c1-600a-472d-ae84-1d5482a2be89', 'c088e98e-9cbf-4228-9281-3f611a59d316', 'dd1ccb34-4714-491c-a490-59fd095e3b30', '6807a680-7aad-4111-a836-a015ee2eafe2'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:12 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:12 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "cinder-12dbc751-33df-4a42-a783-154b38f55eea-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-12dbc751-33df-4a42-a783-154b38f55eea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "cinder-quobyte-12dbc751-33df-4a42-a783-154b38f55eea" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-quobyte-12dbc751-33df-4a42-a783-154b38f55eea" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[41101030-a587-4b5a-ae96-78dc95ab6748]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:13 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea Jul 08 03:45:13 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-1dae3290-1909-495a-9b3c-03354bbcbd6c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-1dae3290-1909-495a-9b3c-03354bbcbd6c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:13 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.703s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Deleted volume successfully. Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "cinder-quobyte-1dae3290-1909-495a-9b3c-03354bbcbd6c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9e6e0e38-1440-4720-9974-29ff0c9319c2 tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-4cae914e-315d-4ed4-b3da-ca0ae28e9e35-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-1dae3290-1909-495a-9b3c-03354bbcbd6c" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4a8961-dbfd-4b1d-89ce-1963f8ad39a8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:13 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c Jul 08 03:45:13 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:14 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea" returned: 0 in 0.882s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:14 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea Jul 08 03:45:14 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:14 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c" returned: 0 in 0.851s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:14 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c Jul 08 03:45:14 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:14 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-12dbc751-33df-4a42-a783-154b38f55eea" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-quobyte-12dbc751-33df-4a42-a783-154b38f55eea" released by "delete_volume" :: held 1.607s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:14 devstack cinder-volume[86294]: WARNING cinder.quota [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-848486077-622238272 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-848486077-622238272, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:45:14 devstack cinder-volume[86294]: WARNING cinder.quota [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-848486077-622238272 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-848486077-622238272, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Created reservations ['72dad85f-09cf-47f4-ae88-48a3721d0d8e', 'cdc3b805-b778-4dca-8847-734fd5c719a3', '3dbb3de5-2dd1-4a81-8992-4b44a00aed32', '7e0a863c-ac13-40dc-a7a0-72cfc005caf8'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:14 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:14 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:15 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1dae3290-1909-495a-9b3c-03354bbcbd6c" returned: 0 in 0.715s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-quobyte-1dae3290-1909-495a-9b3c-03354bbcbd6c" released by "delete_volume" :: held 1.622s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Created reservations ['5da20865-3fa7-424c-9817-ede5c9457621', '680231bf-49cc-4927-b25e-a002513dcb1e', '75b6f119-daaa-4da7-9408-134f1125a009', '14f2b000-9c84-4821-b24d-18d030dcccad'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:15 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:15 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:15 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.698s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Deleted volume successfully. Jul 08 03:45:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5fa4b46f-f885-49e4-840f-84527241743a tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-12dbc751-33df-4a42-a783-154b38f55eea-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:16 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.694s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:16 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Deleted volume successfully. Jul 08 03:45:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6aee3fd-9fa5-4f63-ab23-d95e5bb013be tempest-CinderUnicodeTest-1918363638 None] Lock "cinder-1dae3290-1909-495a-9b3c-03354bbcbd6c-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-cfa65773-4091-4940-a5e3-625ed5411c61 req-a91d80b2-5710-4b2c-84d1-ff9b8ad6de9f tempest-TestInstancesWithCinderVolumes-852146935 None] Terminate volume connection completed successfully. Jul 08 03:45:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-cfa65773-4091-4940-a5e3-625ed5411c61 req-a91d80b2-5710-4b2c-84d1-ff9b8ad6de9f tempest-TestInstancesWithCinderVolumes-852146935 None] Deleting attachment 9f5bc35e-0f3d-4f95-ae3c-79b97aeeff4e. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Flow 'volume_create_manager' (27666cd9-059b-4457-ab04-c6a8756e201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0486c98-5a4e-4773-bc98-662335e4e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0486c98-5a4e-4773-bc98-662335e4e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77534105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95b92e83f924dd5bd1ba20beee220f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:45:19Z,use_quota=True,user_id='769a8e3f17ca4740a179eb3e183d9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1a1b8b-2f67-486e-9e01-5970b4c74f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1a1b8b-2f67-486e-9e01-5970b4c74f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1bc2e6-7b39-450c-8b39-ba70030ca289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1bc2e6-7b39-450c-8b39-ba70030ca289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7', 'volume_name': 'volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f88ac76-53ee-4fe5-afad-b0b678c28386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f88ac76-53ee-4fe5-afad-b0b678c28386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f094585d-d1a5-4752-b6c8-adab595c8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:19 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Volume eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7', 'volume_size': 1} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77534105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95b92e83f924dd5bd1ba20beee220f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:45:19Z,use_quota=True,user_id='769a8e3f17ca4740a179eb3e183d9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Creating volume eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:45:19 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:19 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 1073741824 Jul 08 03:45:19 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "cinder-30348984-7513-490f-8869-f6d05e5cd5db-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-30348984-7513-490f-8869-f6d05e5cd5db-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "cinder-quobyte-30348984-7513-490f-8869-f6d05e5cd5db" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-quobyte-30348984-7513-490f-8869-f6d05e5cd5db" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02ecf4-1bff-4848-82d1-6927710152ac]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:19 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db Jul 08 03:45:19 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:20 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 1073741824" returned: 0 in 0.939s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:20 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 Jul 08 03:45:20 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:20 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db" returned: 0 in 0.829s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:20 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db Jul 08 03:45:20 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:20 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7" returned: 0 in 0.723s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:45:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f094585d-d1a5-4752-b6c8-adab595c8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f158299-4bac-4fb9-ba3c-26132e305b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:21 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Volume volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 (eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7): created successfully Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f158299-4bac-4fb9-ba3c-26132e305b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Flow 'volume_create_manager' (27666cd9-059b-4457-ab04-c6a8756e201a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:45:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6982f9fc-63ae-4f0d-9f53-d8d78de0e481 tempest-ProjectReaderTests-802851049 None] Created volume successfully. Jul 08 03:45:21 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-30348984-7513-490f-8869-f6d05e5cd5db" returned: 0 in 0.776s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-quobyte-30348984-7513-490f-8869-f6d05e5cd5db" released by "delete_volume" :: held 1.663s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:21 devstack cinder-volume[86294]: WARNING cinder.quota [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367314912-1999892551 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367314912-1999892551, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:45:21 devstack cinder-volume[86294]: WARNING cinder.quota [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367314912-1999892551 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367314912-1999892551, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Created reservations ['d3a7b1e0-e948-40fa-a3f6-202893a3dfb4', '35ab9826-85c5-43a1-9a04-bc9e47c7cc48', 'a340d3a2-edfb-471d-8c8e-c4f17046b1ed', '30c4c34f-03f0-4204-abac-b7290a8faec4'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Acquiring lock "cinder-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Lock "cinder-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:21 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:21 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Acquiring lock "cinder-quobyte-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Lock "cinder-quobyte-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad3dd6-b100-44a0-bf45-15bf38b1ec56]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:21 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 Jul 08 03:45:21 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:22 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.765s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:22 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Deleted volume successfully. Jul 08 03:45:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3846d3b5-ba2b-45b6-b746-6c6ef0c9eee1 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-30348984-7513-490f-8869-f6d05e5cd5db-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:22 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7" returned: 0 in 0.890s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:22 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7 Jul 08 03:45:22 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:23 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7" returned: 0 in 0.652s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Lock "cinder-quobyte-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7" released by "delete_volume" :: held 1.607s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Created reservations ['83d42747-cb35-4aaf-8b2d-5d7ff333ebc9', 'e0ad71de-80a7-4705-8587-451dd6ed9647', '898fe436-fa0a-4ff3-8995-967fd375bf22', 'acd5fa50-68b1-4b84-8d7f-45c00c5cf1ca'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:23 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:23 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:24 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:24 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Deleted volume successfully. Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-43a5dded-6dc1-4f71-8251-5039ab68b3a6 tempest-ProjectReaderTests-802851049 None] Lock "cinder-eb0ff7b4-8080-428f-8c0a-2d3d407aa4e7-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Flow 'volume_create_manager' (cd74af8e-0115-4d38-a94d-8279fa545c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e46248-3c11-43e1-959f-0349e4a47faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e46248-3c11-43e1-959f-0349e4a47faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531775683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414b76cd-f387-49d8-9f94-2a7865b1fce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95b92e83f924dd5bd1ba20beee220f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:45:24Z,use_quota=True,user_id='769a8e3f17ca4740a179eb3e183d9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa1ea23-8ff6-4628-841d-829de0a98c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa1ea23-8ff6-4628-841d-829de0a98c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d6e860-af60-4b36-8c6d-263601ef6140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d6e860-af60-4b36-8c6d-263601ef6140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414b76cd-f387-49d8-9f94-2a7865b1fce9', 'volume_name': 'volume-414b76cd-f387-49d8-9f94-2a7865b1fce9', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee612f62-d0a1-426e-988d-4eab16810982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee612f62-d0a1-426e-988d-4eab16810982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6e580f-e1dd-4193-a5b9-993b844b62f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:24 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Volume 414b76cd-f387-49d8-9f94-2a7865b1fce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414b76cd-f387-49d8-9f94-2a7865b1fce9', 'volume_size': 1} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531775683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414b76cd-f387-49d8-9f94-2a7865b1fce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95b92e83f924dd5bd1ba20beee220f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:45:24Z,use_quota=True,user_id='769a8e3f17ca4740a179eb3e183d9b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Creating volume 414b76cd-f387-49d8-9f94-2a7865b1fce9 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:45:24 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:45:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:24 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 1073741824 Jul 08 03:45:24 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:25 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 1073741824" returned: 0 in 0.913s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:25 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 Jul 08 03:45:25 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:26 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9" returned: 0 in 0.618s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6e580f-e1dd-4193-a5b9-993b844b62f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414b76cd-f387-49d8-9f94-2a7865b1fce9', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9014c01-0326-4c33-b678-06e7bf3aded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:45:26 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Volume volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 (414b76cd-f387-49d8-9f94-2a7865b1fce9): created successfully Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9014c01-0326-4c33-b678-06e7bf3aded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Flow 'volume_create_manager' (cd74af8e-0115-4d38-a94d-8279fa545c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:45:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1d5e7a02-a3fb-4c7b-a611-2c1750738c67 tempest-ProjectReaderTests-802851049 None] Created volume successfully. Jul 08 03:45:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-86b75043-0389-463f-ba52-2b90a174ef01 req-46ad3cf9-c4c8-409c-98e8-a4962b39c321 tempest-TestInstancesWithCinderVolumes-852146935 None] Terminate volume connection completed successfully. Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-86b75043-0389-463f-ba52-2b90a174ef01 req-46ad3cf9-c4c8-409c-98e8-a4962b39c321 tempest-TestInstancesWithCinderVolumes-852146935 None] Deleting attachment 4f452b11-5a0e-4bdf-b534-8de5203ca992. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Acquiring lock "cinder-414b76cd-f387-49d8-9f94-2a7865b1fce9-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Lock "cinder-414b76cd-f387-49d8-9f94-2a7865b1fce9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Acquiring lock "cinder-quobyte-414b76cd-f387-49d8-9f94-2a7865b1fce9" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Lock "cinder-quobyte-414b76cd-f387-49d8-9f94-2a7865b1fce9" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[70efd3d0-88c9-42d8-98c4-9821d1778541]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:26 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 Jul 08 03:45:26 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:27 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:27 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9 Jul 08 03:45:27 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:27 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-414b76cd-f387-49d8-9f94-2a7865b1fce9" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Lock "cinder-quobyte-414b76cd-f387-49d8-9f94-2a7865b1fce9" released by "delete_volume" :: held 1.460s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Created reservations ['d7712236-5fc0-4122-a44c-70542b31160b', '071a9687-6fcb-406a-84d8-ef234733379f', 'eaa36b29-8e68-45d0-bee3-34e332a0439e', 'bcc7d65c-3360-4e7d-bb97-82de5b7081cb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:28 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:28 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:28 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.678s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Deleted volume successfully. Jul 08 03:45:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-822133af-9619-4cac-b352-9f8bce2f8246 tempest-ProjectReaderTests-802851049 None] Lock "cinder-414b76cd-f387-49d8-9f94-2a7865b1fce9-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "cinder-03efea3f-5183-483b-8122-9a5e811f2a30-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-03efea3f-5183-483b-8122-9a5e811f2a30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "cinder-quobyte-03efea3f-5183-483b-8122-9a5e811f2a30" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:45:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-quobyte-03efea3f-5183-483b-8122-9a5e811f2a30" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:45:29 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4bcf1c-fdea-47d5-b639-b899cf60df9a]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:45:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:29 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:45:29 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:30 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 0 in 0.817s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:30 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:45:30 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:31 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 1 in 0.751s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:45:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:31 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30 Jul 08 03:45:31 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:31 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-03efea3f-5183-483b-8122-9a5e811f2a30" returned: 0 in 0.641s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-quobyte-03efea3f-5183-483b-8122-9a5e811f2a30" released by "delete_volume" :: held 2.276s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:31 devstack cinder-volume[86294]: WARNING cinder.quota [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1567824069-543772625 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1567824069-543772625, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:45:31 devstack cinder-volume[86294]: WARNING cinder.quota [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1567824069-543772625 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1567824069-543772625, it is now deprecated. Please use the default quota class for default quota. Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Created reservations ['53a50525-29ce-4b46-8d95-b76df81c0dfb', 'fd4855fe-9ec3-4601-b296-8ddbcf2231a7', 'dfe9cb8c-51fe-43da-8a24-b4127fe5667a', 'a4419b7f-618a-46d8-90b2-7a7b9779ea38'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:32 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:32 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:32 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.662s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Deleted volume successfully. Jul 08 03:45:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7c2d9b0e-6972-4b3b-8abc-05597ef3dbc7 tempest-TestInstancesWithCinderVolumes-852146935 None] Lock "cinder-03efea3f-5183-483b-8122-9a5e811f2a30-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:45:42 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=79,cinder:UPDATE=100,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:45:42 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=77,cinder:INSERT=28,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:45:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:45:47 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:45:47 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:45:47 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 08 03:45:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:45:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:45:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:45:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:45:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:46:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:46:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Flow 'volume_create_manager' (e704ba43-8b02-4dc5-a51d-20386ee87515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6fc107-ec37-4e2b-aa2c-5b3015a020ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6fc107-ec37-4e2b-aa2c-5b3015a020ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1446951929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1daa2f0-7adf-4b85-a6b8-956bef4baff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a916d63077084df0ad565d62af5e2724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:46:37Z,use_quota=True,user_id='c46b0db6b7ea4809bda17c87de8f5c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40b87a-8aef-4347-bcbe-65f60af1bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d40b87a-8aef-4347-bcbe-65f60af1bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba3d3c-9054-4d15-b68e-42b509d5347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba3d3c-9054-4d15-b68e-42b509d5347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1daa2f0-7adf-4b85-a6b8-956bef4baff7', 'volume_name': 'volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3253b991-1b1f-45ed-87cb-5dce6c7a31f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3253b991-1b1f-45ed-87cb-5dce6c7a31f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ba5cf4-aed6-4e4a-b606-453e0bbc39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:46:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Volume a1daa2f0-7adf-4b85-a6b8-956bef4baff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7', 'volume_size': 1} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1446951929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1daa2f0-7adf-4b85-a6b8-956bef4baff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a916d63077084df0ad565d62af5e2724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:46:37Z,use_quota=True,user_id='c46b0db6b7ea4809bda17c87de8f5c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Creating volume a1daa2f0-7adf-4b85-a6b8-956bef4baff7 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:46:36 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:46:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:36 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 1073741824 Jul 08 03:46:36 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:37 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 1073741824" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:37 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 Jul 08 03:46:37 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:38 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" returned: 0 in 0.633s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ba5cf4-aed6-4e4a-b606-453e0bbc39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365584e7-9f06-42b6-a312-b3ecae1a9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:46:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Volume volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 (a1daa2f0-7adf-4b85-a6b8-956bef4baff7): created successfully Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365584e7-9f06-42b6-a312-b3ecae1a9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:46:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Flow 'volume_create_manager' (e704ba43-8b02-4dc5-a51d-20386ee87515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:46:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a1058ee1-ac4f-4b3d-a7e0-9b0ed0e5ccca tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Created volume successfully. Jul 08 03:46:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:46:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:46:41 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4246a6-6330-4fd2-8a75-14cd64a29bac]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:46:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:42 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 Jul 08 03:46:42 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:42 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" returned: 0 in 0.747s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:46:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fed6c6d-eded-4410-b57f-b092f3107447', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:46:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-2c35ed9d-604f-4f74-b626-2a7adf9cd277 req-7eac3815-8aaa-4d92-9bc3-f93ce9d53b23 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] attachment_update completed successfully. Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:46:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:47 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:46:47 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:47 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.695s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:46:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:46:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:46:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:46:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-59831a2f-ab73-493d-85d7-79744e3d7672 req-f0e1d96a-4a12-4ec4-8ecc-db36a80ebaa3 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Terminate volume connection completed successfully. Jul 08 03:46:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-59831a2f-ab73-493d-85d7-79744e3d7672 req-f0e1d96a-4a12-4ec4-8ecc-db36a80ebaa3 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Deleting attachment 5fed6c6d-eded-4410-b57f-b092f3107447. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:46:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Acquiring lock "cinder-a1daa2f0-7adf-4b85-a6b8-956bef4baff7-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:46:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "cinder-a1daa2f0-7adf-4b85-a6b8-956bef4baff7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:46:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Acquiring lock "cinder-quobyte-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:46:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "cinder-quobyte-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:46:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a0ff53-5795-4d51-ae54-18b44a60d3de]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:46:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:51 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 Jul 08 03:46:51 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:51 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" returned: 0 in 0.763s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:51 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7 Jul 08 03:46:51 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:52 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "cinder-quobyte-a1daa2f0-7adf-4b85-a6b8-956bef4baff7" released by "delete_volume" :: held 1.449s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Created reservations ['5524b010-f3d1-4474-b696-562992f7dd47', '88ac0158-5245-483d-985b-2e1a1e65eb19', '6d0d5b0d-6248-49e0-9a10-b32e9cf7718f', '68f58054-504f-43aa-8b70-5e186c9fda90'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:46:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:46:52 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:46:52 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:46:53 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 08 03:46:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.630s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:46:53 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:46:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Deleted volume successfully. Jul 08 03:46:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-885ccf37-6c83-45a3-8cab-f08853083487 tempest-TestServerVolumeAttachScenarioOldVersion-1383051654 None] Lock "cinder-a1daa2f0-7adf-4b85-a6b8-956bef4baff7-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:47:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=9,cinder:SELECT=14,cinder:INSERT=2 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:47:03 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=13,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Flow 'volume_create_manager' (cc584cf8-c9cc-47d7-85a2-40d0b9cabed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0bdb4a-adb0-43c9-aaf3-cfd8678d3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0bdb4a-adb0-43c9-aaf3-cfd8678d3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1804387034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040fe12e-b760-4daf-a92d-ccde0c259b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc6a967801e420ea6609c0217f69a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:47:32Z,use_quota=True,user_id='6d3918449bb14d4aa43ccf87e0518b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e52148-20cb-48a8-a7ef-204552e12068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e52148-20cb-48a8-a7ef-204552e12068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e887e0-4bb3-4f6d-a4d0-8d7ce5ed6ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e887e0-4bb3-4f6d-a4d0-8d7ce5ed6ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '040fe12e-b760-4daf-a92d-ccde0c259b36', 'volume_name': 'volume-040fe12e-b760-4daf-a92d-ccde0c259b36', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0518d60-9ab3-4fe3-b0f7-d7cdfba7719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0518d60-9ab3-4fe3-b0f7-d7cdfba7719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cde392-a00a-46d3-8167-9961a144a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:47:32 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Volume 040fe12e-b760-4daf-a92d-ccde0c259b36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-040fe12e-b760-4daf-a92d-ccde0c259b36', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Trying to clone 040fe12e-b760-4daf-a92d-ccde0c259b36 from image ad206503-c10d-4ca1-92a8-b1a38f579b05 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:47:32 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Image download 20.69 MB at 20.69 MB/s Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca2415-d34f-49b7-b845-82f7cb923f1e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:47:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:32 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD Jul 08 03:47:32 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:33 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:33 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 is fetched for user 6d3918449bb14d4aa43ccf87e0518b62. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:47:33 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[194736b0-3818-440a-8d08-b1ed0e71acfb]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:47:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:33 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD Jul 08 03:47:33 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:34 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1804387034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040fe12e-b760-4daf-a92d-ccde0c259b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc6a967801e420ea6609c0217f69a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:47:32Z,use_quota=True,user_id='6d3918449bb14d4aa43ccf87e0518b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Creating volume 040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:47:34 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:34 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 1073741824 Jul 08 03:47:34 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:34 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 1073741824" returned: 0 in 0.786s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:35 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:47:35 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:35 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 0.630s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Attempting download of ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 040fe12e-b760-4daf-a92d-ccde0c259b36. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac3a032-26f3-47d6-90a0-8943763811ef]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:47:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:35 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo Jul 08 03:47:35 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:36 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo" returned: 0 in 0.723s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:36 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo Jul 08 03:47:36 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:37 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo" returned: 1 in 0.711s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad206503-c10d-4ca1-92a8-b1a38f579b05_5wkaoxdo' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed6fdf-2743-4d41-a9b2-b4787b47885c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:37 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD Jul 08 03:47:37 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:37 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] ad206503-c10d-4ca1-92a8-b1a38f579b05 was qcow2, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:47:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:37 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:47:37 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:39 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 1.780s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:39 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad206503-c10d-4ca1-92a8-b1a38f579b05_d47umaaodevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:47:39 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Converted 112.00 MB image at 62.86 MB/s Jul 08 03:47:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:39 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 1G Jul 08 03:47:39 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:40 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 1G" returned: 0 in 0.683s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c2d137-842b-41c0-b183-f5331a09ee78]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:47:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:40 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:47:40 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:41 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 0.739s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:41 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:47:41 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:41 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 1 in 0.724s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Downloaded image ad206503-c10d-4ca1-92a8-b1a38f579b05 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}])) to volume 040fe12e-b760-4daf-a92d-ccde0c259b36 successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Temporary image ad206503-c10d-4ca1-92a8-b1a38f579b05 for user 6d3918449bb14d4aa43ccf87e0518b62 is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Marking volume 040fe12e-b760-4daf-a92d-ccde0c259b36 as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Copying metadata from image ad206503-c10d-4ca1-92a8-b1a38f579b05 to 040fe12e-b760-4daf-a92d-ccde0c259b36. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Creating volume glance metadata for volume 040fe12e-b760-4daf-a92d-ccde0c259b36 backed by image ad206503-c10d-4ca1-92a8-b1a38f579b05 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cde392-a00a-46d3-8167-9961a144a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040fe12e-b760-4daf-a92d-ccde0c259b36', 'volume_size': 1, 'image_id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad206503-c10d-4ca1-92a8-b1a38f579b05', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '293d8aa1a3e74c7685ecbff47cbee55d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad206503-c10d-4ca1-92a8-b1a38f579b05', 'created_at': datetime.datetime(2026, 7, 8, 1, 19, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 19, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad206503-c10d-4ca1-92a8-b1a38f579b05/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786cf299-77b4-4416-ad7a-fe367dd7d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:47:41 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Volume volume-040fe12e-b760-4daf-a92d-ccde0c259b36 (040fe12e-b760-4daf-a92d-ccde0c259b36): created successfully Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786cf299-77b4-4416-ad7a-fe367dd7d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:47:41 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Flow 'volume_create_manager' (cc584cf8-c9cc-47d7-85a2-40d0b9cabed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:47:41 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-922d50d9-7571-46e6-a0cc-f91fac6c0bcd tempest-TestShelveInstance-558978757 None] Created volume successfully. Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:47:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:47 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:47:47 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:47 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.630s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:47:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:47:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:47:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:47:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:47:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:47:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[333410c9-f35b-4262-af82-098c7b4df8d1]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:47:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:49 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:47:49 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:50 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:47:50 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:47:50 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:47:51 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 08 03:47:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 1 in 0.733s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:47:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:47:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.549s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:47:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-040fe12e-b760-4daf-a92d-ccde0c259b36', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '791b9354-eaeb-4e3f-ae1c-66b2b84aff06', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:47:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-a9550187-79b2-4f81-b5b6-f0ee2e50c867 req-e40e4018-24b8-4628-bf82-da318310170f tempest-TestShelveInstance-558978757 None] attachment_update completed successfully. Jul 08 03:48:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:48:02 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=8,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:48:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-3ff35e8a-e288-4d90-badc-2d24797a82fa req-4e5a3887-4cee-40af-97d6-c6ad67f76b98 tempest-TestShelveInstance-558978757 None] Terminate volume connection completed successfully. Jul 08 03:48:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-3ff35e8a-e288-4d90-badc-2d24797a82fa req-4e5a3887-4cee-40af-97d6-c6ad67f76b98 tempest-TestShelveInstance-558978757 None] Deleting attachment 791b9354-eaeb-4e3f-ae1c-66b2b84aff06. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:48:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:48:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:48:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61a6f99-cf42-446f-8499-b00d78501484]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:48:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:48:34 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:48:34 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:48:34 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 08 03:48:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:48:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:48:34 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:48:34 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:48:35 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 08 03:48:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 1 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:48:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:48:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.503s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:48:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df', 'name': 'volume-040fe12e-b760-4daf-a92d-ccde0c259b36', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab597d1e-a630-4d2a-8eb3-5ab46b8d7efe', 'enforce_multipath': True} {{(pid=86294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 03:48:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-2c1945b7-2042-421b-a265-719af703c3ca req-651115cc-f8be-4d09-8ece-c6a61392df49 tempest-TestShelveInstance-558978757 None] attachment_update completed successfully. Jul 08 03:48:45 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:48:45 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=7 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:48:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:48:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:48:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:48:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:48:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:48:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:48:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:48:47 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:48:47 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:48:47 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 08 03:48:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:48:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:48:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:48:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:48:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:49:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-1fe57fa2-58fa-4cb5-a245-9410958bff1e tempest-TestShelveInstance-558978757 None] Terminate volume connection completed successfully. Jul 08 03:49:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-1fe57fa2-58fa-4cb5-a245-9410958bff1e tempest-TestShelveInstance-558978757 None] Deleting attachment ab597d1e-a630-4d2a-8eb3-5ab46b8d7efe. {{(pid=86294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 03:49:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Acquiring lock "cinder-040fe12e-b760-4daf-a92d-ccde0c259b36-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Lock "cinder-040fe12e-b760-4daf-a92d-ccde0c259b36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Acquiring lock "cinder-quobyte-040fe12e-b760-4daf-a92d-ccde0c259b36" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Lock "cinder-quobyte-040fe12e-b760-4daf-a92d-ccde0c259b36" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf3a48-0a32-46b3-9544-c378c559e2c6]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:49:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:15 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:49:15 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:16 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 0.724s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:16 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:49:16 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:16 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 1 in 0.722s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:49:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:16 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36 Jul 08 03:49:16 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:17 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-040fe12e-b760-4daf-a92d-ccde0c259b36" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Lock "cinder-quobyte-040fe12e-b760-4daf-a92d-ccde0c259b36" released by "delete_volume" :: held 2.157s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG cinder.quota [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Created reservations ['33c821d7-3564-46db-bdf7-c252c3efe98c', '9c3a8cd2-34a6-495c-8c3a-682fa4c17858', 'e65baafc-ce5d-4198-8378-881f7c990bb2', '60112292-2595-4ae7-bc90-e5d4e4c14004'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:17 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:49:17 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:18 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.683s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:18 devstack cinder-volume[86294]: DEBUG cinder.manager [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:49:18 devstack cinder-volume[86294]: INFO cinder.volume.manager [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Deleted volume successfully. Jul 08 03:49:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [req-2cd716e9-8e3c-4686-9a02-f0e2fb853036 req-3679e727-418a-40e5-aa9e-1779f08a5701 tempest-TestShelveInstance-558978757 None] Lock "cinder-040fe12e-b760-4daf-a92d-ccde0c259b36-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:27 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (9ce0efc5-1ec6-4e49-b677-baa651afef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab637297-0711-490e-90bd-4b4f175c7e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab637297-0711-490e-90bd-4b4f175c7e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715558161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4899ba-d37a-467d-9a37-3596db04b39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:28Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08936ac3-679e-4a97-88f6-af9e51fe98e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08936ac3-679e-4a97-88f6-af9e51fe98e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e377602f-06a5-4b20-aace-183095684465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e377602f-06a5-4b20-aace-183095684465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4899ba-d37a-467d-9a37-3596db04b39c', 'volume_name': 'volume-6c4899ba-d37a-467d-9a37-3596db04b39c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979de262-1842-40d8-bbdb-f9ec3309d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979de262-1842-40d8-bbdb-f9ec3309d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a556149e-c83e-4e9c-88f2-acd141d05ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:28 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Volume 6c4899ba-d37a-467d-9a37-3596db04b39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4899ba-d37a-467d-9a37-3596db04b39c', 'volume_size': 1} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715558161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4899ba-d37a-467d-9a37-3596db04b39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:28Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Creating volume 6c4899ba-d37a-467d-9a37-3596db04b39c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:49:28 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:49:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:28 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c 1073741824 Jul 08 03:49:28 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:29 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c 1073741824" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:29 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c Jul 08 03:49:29 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:29 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:49:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a556149e-c83e-4e9c-88f2-acd141d05ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4899ba-d37a-467d-9a37-3596db04b39c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11511b3d-752c-4b1e-95ca-8c4a753d8c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:30 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Volume volume-6c4899ba-d37a-467d-9a37-3596db04b39c (6c4899ba-d37a-467d-9a37-3596db04b39c): created successfully Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11511b3d-752c-4b1e-95ca-8c4a753d8c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (9ce0efc5-1ec6-4e49-b677-baa651afef36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f7ac1ddd-eb8a-4f87-b468-dd31eb74f7e1 tempest-ProjectReaderTests-1115633295 None] Created volume successfully. Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-6c4899ba-d37a-467d-9a37-3596db04b39c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Lock "cinder-6c4899ba-d37a-467d-9a37-3596db04b39c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-quobyte-6c4899ba-d37a-467d-9a37-3596db04b39c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-6c4899ba-d37a-467d-9a37-3596db04b39c" acquired by "delete_volume" :: waited 0.012s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[44db8acf-a75a-4014-8bc9-140a54ba8021]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:49:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:30 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c Jul 08 03:49:30 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:31 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:31 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c Jul 08 03:49:31 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:32 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6c4899ba-d37a-467d-9a37-3596db04b39c" returned: 0 in 0.626s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-6c4899ba-d37a-467d-9a37-3596db04b39c" released by "delete_volume" :: held 1.397s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Created reservations ['7e9d98f0-f1d0-4c6a-9b7f-f2adf6f626b8', '5c4d7cc5-8eae-492c-9171-a717ba87603c', '37a8f2ab-4c88-44a6-b97d-2f89d38bec2c', '6d50acbb-6312-46ee-b215-09fffe63e48a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:32 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:49:32 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:32 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.643s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:49:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Deleted volume successfully. Jul 08 03:49:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d797559b-2639-4532-baa4-c36bd495a48b tempest-ProjectReaderTests-1115633295 None] Lock "cinder-6c4899ba-d37a-467d-9a37-3596db04b39c-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (3354fc1e-a67c-48aa-9d16-2d4c6660a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a07aaa8-1784-49f0-8cb2-f767dbbec97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a07aaa8-1784-49f0-8cb2-f767dbbec97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579950289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853dab1a-7131-47da-93a2-e8498fd8df2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:33Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27fe436-fdbb-44ad-8229-7f60e303f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27fe436-fdbb-44ad-8229-7f60e303f617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e051886-fd35-4222-88a4-0b9a44165bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e051886-fd35-4222-88a4-0b9a44165bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853dab1a-7131-47da-93a2-e8498fd8df2e', 'volume_name': 'volume-853dab1a-7131-47da-93a2-e8498fd8df2e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ee4848-9b93-4187-8066-9c4a77a766fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ee4848-9b93-4187-8066-9c4a77a766fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35ecd32-5ca9-41d3-a03b-7964a12b0220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:33 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Volume 853dab1a-7131-47da-93a2-e8498fd8df2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853dab1a-7131-47da-93a2-e8498fd8df2e', 'volume_size': 1} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579950289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853dab1a-7131-47da-93a2-e8498fd8df2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:33Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Creating volume 853dab1a-7131-47da-93a2-e8498fd8df2e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:49:33 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:49:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:33 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e 1073741824 Jul 08 03:49:33 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:34 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e 1073741824" returned: 0 in 0.783s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:34 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e Jul 08 03:49:34 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:34 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e" returned: 0 in 0.623s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35ecd32-5ca9-41d3-a03b-7964a12b0220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853dab1a-7131-47da-93a2-e8498fd8df2e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83db90b0-a364-43d0-bb0a-3ee58d4ef039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Volume volume-853dab1a-7131-47da-93a2-e8498fd8df2e (853dab1a-7131-47da-93a2-e8498fd8df2e): created successfully Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83db90b0-a364-43d0-bb0a-3ee58d4ef039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (3354fc1e-a67c-48aa-9d16-2d4c6660a942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3f3559e2-d708-41fe-a12f-c44a5df6bf4b tempest-ProjectReaderTests-1115633295 None] Created volume successfully. Jul 08 03:49:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-853dab1a-7131-47da-93a2-e8498fd8df2e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Lock "cinder-853dab1a-7131-47da-93a2-e8498fd8df2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-quobyte-853dab1a-7131-47da-93a2-e8498fd8df2e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-853dab1a-7131-47da-93a2-e8498fd8df2e" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad853b81-7f48-4fd1-a824-733c9d15ceb7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:49:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:35 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e Jul 08 03:49:35 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:36 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e" returned: 0 in 0.741s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:36 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e Jul 08 03:49:36 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:36 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-853dab1a-7131-47da-93a2-e8498fd8df2e" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-853dab1a-7131-47da-93a2-e8498fd8df2e" released by "delete_volume" :: held 1.426s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Created reservations ['67a3f977-ddce-423e-96c7-2a3a20af7f54', '935b7918-eeeb-4a1e-a7cf-62f130d9617a', '7a1f432e-a061-4b32-a0f9-5ddedf7d8cd0', '16fb5c7e-32e7-4bea-b60a-d08d7fe140f9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:36 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:49:36 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:37 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.643s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:37 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:49:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Deleted volume successfully. Jul 08 03:49:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd7bd493-5ab9-4e25-8b11-b5dc3f90b0ef tempest-ProjectReaderTests-1115633295 None] Lock "cinder-853dab1a-7131-47da-93a2-e8498fd8df2e-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:37 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (b51f37f4-8ce2-4bef-b22d-2bdca812483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df43b208-f1da-468b-8dd6-530546554d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df43b208-f1da-468b-8dd6-530546554d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052299214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce76715-9cbe-49a2-ba0f-2abfc56ab80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:38Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e68171-5d51-4db9-a45a-332b83448af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e68171-5d51-4db9-a45a-332b83448af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc1707e-4612-4623-b784-674ac6809553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc1707e-4612-4623-b784-674ac6809553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce76715-9cbe-49a2-ba0f-2abfc56ab80f', 'volume_name': 'volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05c6608-4392-48d3-9e16-0865c6988ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05c6608-4392-48d3-9e16-0865c6988ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3dbedd-d1ff-4b70-b208-2527b2410b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Volume bce76715-9cbe-49a2-ba0f-2abfc56ab80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f', 'volume_size': 1} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052299214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce76715-9cbe-49a2-ba0f-2abfc56ab80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:38Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Creating volume bce76715-9cbe-49a2-ba0f-2abfc56ab80f {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:49:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:38 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f 1073741824 Jul 08 03:49:38 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:38 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f 1073741824" returned: 0 in 0.798s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:38 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f Jul 08 03:49:38 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:39 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3dbedd-d1ff-4b70-b208-2527b2410b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cb0684-e1de-4630-979b-298bc74e8870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Volume volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f (bce76715-9cbe-49a2-ba0f-2abfc56ab80f): created successfully Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cb0684-e1de-4630-979b-298bc74e8870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (b51f37f4-8ce2-4bef-b22d-2bdca812483e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2656c969-1058-4654-8640-e1e540566f19 tempest-ProjectReaderTests-1115633295 None] Created volume successfully. Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-bce76715-9cbe-49a2-ba0f-2abfc56ab80f-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-bce76715-9cbe-49a2-ba0f-2abfc56ab80f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-quobyte-bce76715-9cbe-49a2-ba0f-2abfc56ab80f" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-bce76715-9cbe-49a2-ba0f-2abfc56ab80f" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf6e6d-accf-4535-9a97-a7c458ee2aa7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:40 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f Jul 08 03:49:40 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:40 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f" returned: 0 in 0.766s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:40 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f Jul 08 03:49:40 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:41 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bce76715-9cbe-49a2-ba0f-2abfc56ab80f" returned: 0 in 0.636s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-bce76715-9cbe-49a2-ba0f-2abfc56ab80f" released by "delete_volume" :: held 1.439s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Created reservations ['1cb053fd-8512-4392-82b3-7c01026eeae2', '941044bd-ee6d-4421-8cb9-3158b54c5ab0', 'c5dee26d-8bb0-44de-8a86-45fd1d615ef4', '9cfe7f3d-3ce1-4199-9ed2-abc698607e89'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:41 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:49:41 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:42 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.653s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:49:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Deleted volume successfully. Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-15740b27-a8e7-4f72-9eb4-6d540678eb42 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-bce76715-9cbe-49a2-ba0f-2abfc56ab80f-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (337cc79f-5340-4ca4-8ee4-b07659414072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5d39b4-723e-4a1c-9dd4-0e0a6b2bf1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5d39b4-723e-4a1c-9dd4-0e0a6b2bf1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862506925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bdb982-f530-4638-8846-4671803aea88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:43Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87630b4b-228e-4b4b-b050-9d97e1cd40fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87630b4b-228e-4b4b-b050-9d97e1cd40fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c0e39a-e06d-4e08-926f-1553cc3af8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c0e39a-e06d-4e08-926f-1553cc3af8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bdb982-f530-4638-8846-4671803aea88', 'volume_name': 'volume-d3bdb982-f530-4638-8846-4671803aea88', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4386da1-d669-4196-8690-3b1bbfb6db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4386da1-d669-4196-8690-3b1bbfb6db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c389ca3-7380-474b-9a89-e7d7d96cc752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:42 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Volume d3bdb982-f530-4638-8846-4671803aea88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bdb982-f530-4638-8846-4671803aea88', 'volume_size': 1} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862506925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bdb982-f530-4638-8846-4671803aea88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae8b010d34b48058ad5fde4fcb4ec87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:43Z,use_quota=True,user_id='9118a7b574d245fd8553854ddd44f6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Creating volume d3bdb982-f530-4638-8846-4671803aea88 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:49:42 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:49:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:42 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 1073741824 Jul 08 03:49:42 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:43 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 1073741824" returned: 0 in 0.813s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:43 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 Jul 08 03:49:43 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:44 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c389ca3-7380-474b-9a89-e7d7d96cc752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bdb982-f530-4638-8846-4671803aea88', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f45ad4-c951-4d25-a591-2d10316bf054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:44 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Volume volume-d3bdb982-f530-4638-8846-4671803aea88 (d3bdb982-f530-4638-8846-4671803aea88): created successfully Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f45ad4-c951-4d25-a591-2d10316bf054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Flow 'volume_create_manager' (337cc79f-5340-4ca4-8ee4-b07659414072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f0918bc0-7729-4d95-9eba-e77226f240a6 tempest-ProjectReaderTests-1115633295 None] Created volume successfully. Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-d3bdb982-f530-4638-8846-4671803aea88-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-d3bdb982-f530-4638-8846-4671803aea88-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "cinder-quobyte-d3bdb982-f530-4638-8846-4671803aea88" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-d3bdb982-f530-4638-8846-4671803aea88" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f85d714-7754-4e47-b700-d50f70a16372]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:49:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:45 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 Jul 08 03:49:45 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:45 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88" returned: 0 in 0.742s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:45 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88 Jul 08 03:49:45 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:46 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d3bdb982-f530-4638-8846-4671803aea88" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-quobyte-d3bdb982-f530-4638-8846-4671803aea88" released by "delete_volume" :: held 1.419s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Created reservations ['f0ea5c01-da81-4928-95b4-e2ceb014ea64', 'ece1ba77-a4a4-410d-b785-79fdf7d39d78', '9774ea20-84f3-4367-8e5e-990275a2d65f', 'e8aca65b-a7c0-4fbe-b576-9f38efb81e22'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:46 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:49:46 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:47 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:49:47 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:47 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.650s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:49:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Deleted volume successfully. Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6794e4f9-0232-481a-9ab3-203e4251c041 tempest-ProjectReaderTests-1115633295 None] Lock "cinder-d3bdb982-f530-4638-8846-4671803aea88-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:49:47 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.694s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:49:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (3144e4e1-4def-4a6b-91c3-80bea7fd6097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00706db9-bca9-4326-a81b-230ccc63ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00706db9-bca9-4326-a81b-230ccc63ef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2045702946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894b39db-0bba-4772-b6d9-beebf7efa987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:59Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d039fd67-d9a3-4ea9-b251-10bc7d478a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d039fd67-d9a3-4ea9-b251-10bc7d478a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07afd435-6f7e-4f36-9831-6ccb00d15f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07afd435-6f7e-4f36-9831-6ccb00d15f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894b39db-0bba-4772-b6d9-beebf7efa987', 'volume_name': 'volume-894b39db-0bba-4772-b6d9-beebf7efa987', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7638dfa-3cf5-49dc-80bc-da7054da95b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7638dfa-3cf5-49dc-80bc-da7054da95b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162c79a-b3e2-4055-808b-df4683bf2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Volume 894b39db-0bba-4772-b6d9-beebf7efa987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894b39db-0bba-4772-b6d9-beebf7efa987', 'volume_size': 1} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2045702946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894b39db-0bba-4772-b6d9-beebf7efa987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:59Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Creating volume 894b39db-0bba-4772-b6d9-beebf7efa987 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:49:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:49:59 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 1073741824 Jul 08 03:49:59 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (f780a569-2fc9-47ce-9ed7-3d50096da54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fb9a89-29fe-4592-b06f-28757afa49b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fb9a89-29fe-4592-b06f-28757afa49b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061654451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b998e3a-e6aa-4bbd-8300-854565d24f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:59Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130f9606-09ce-4577-8b08-fc7f72f921af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130f9606-09ce-4577-8b08-fc7f72f921af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981cb6da-b390-448b-bd0a-b6768b59910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981cb6da-b390-448b-bd0a-b6768b59910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b998e3a-e6aa-4bbd-8300-854565d24f08', 'volume_name': 'volume-1b998e3a-e6aa-4bbd-8300-854565d24f08', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4065104-34a3-4fd6-bf8d-938ddce0ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4065104-34a3-4fd6-bf8d-938ddce0ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3b0785-40cb-4afb-918f-ee3f93ab95be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume 1b998e3a-e6aa-4bbd-8300-854565d24f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b998e3a-e6aa-4bbd-8300-854565d24f08', 'volume_size': 1} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (328b62f6-61d2-44ba-ab2e-339444191ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41285ea-3418-4fd0-8acb-6d27ff7b436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41285ea-3418-4fd0-8acb-6d27ff7b436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348342622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89a4b91-a993-4690-bce2-2aedcbe1e271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:59Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb046300-495d-40ef-8e44-f9b548383580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb046300-495d-40ef-8e44-f9b548383580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a83590f-0d30-4677-9741-beb905c4535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a83590f-0d30-4677-9741-beb905c4535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89a4b91-a993-4690-bce2-2aedcbe1e271', 'volume_name': 'volume-f89a4b91-a993-4690-bce2-2aedcbe1e271', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31edb1b-85fb-4601-9e4b-a9c0beaa4f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31edb1b-85fb-4601-9e4b-a9c0beaa4f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef577b80-dfbe-4bbb-952f-6e7641f28317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:49:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Volume f89a4b91-a993-4690-bce2-2aedcbe1e271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89a4b91-a993-4690-bce2-2aedcbe1e271', 'volume_size': 1} Jul 08 03:49:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (ab77ca75-ab49-4138-8722-109b2123732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67955159-df3c-4ece-a943-626e0528c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67955159-df3c-4ece-a943-626e0528c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482043639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614f082d-3c77-4ec9-84ce-b6b499092d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:00Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7092f58-bf17-4f86-8710-05b0b56eb478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7092f58-bf17-4f86-8710-05b0b56eb478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6321a89-27ba-4ef9-8b5f-fc24a6a74e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6321a89-27ba-4ef9-8b5f-fc24a6a74e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614f082d-3c77-4ec9-84ce-b6b499092d39', 'volume_name': 'volume-614f082d-3c77-4ec9-84ce-b6b499092d39', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2dcaa9-2625-4ad4-9cbe-651466bb64dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2dcaa9-2625-4ad4-9cbe-651466bb64dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23f222c-649c-41c9-bd2a-26b5046028a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Volume 614f082d-3c77-4ec9-84ce-b6b499092d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614f082d-3c77-4ec9-84ce-b6b499092d39', 'volume_size': 1} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:00 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 1073741824" returned: 0 in 1.143s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:00 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 Jul 08 03:50:00 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (07e493e1-5afe-471a-82fe-1eb5892177b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206195f6-642a-4952-b00f-c491e571cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206195f6-642a-4952-b00f-c491e571cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422192988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c423bf28-1580-4aa1-9d59-89aef0d5a8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:01Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221e6b08-7e07-4ef1-bcc9-78ad146885d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221e6b08-7e07-4ef1-bcc9-78ad146885d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243afb20-cfff-4e0f-ac98-55c21097fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243afb20-cfff-4e0f-ac98-55c21097fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c423bf28-1580-4aa1-9d59-89aef0d5a8d6', 'volume_name': 'volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3ad2c7-7276-4550-8e40-4b12623810e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3ad2c7-7276-4550-8e40-4b12623810e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b906d8c8-5e9d-4a53-97eb-90342a52ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:00 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Volume c423bf28-1580-4aa1-9d59-89aef0d5a8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6', 'volume_size': 1} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (20bf4df4-ee22-4883-a1bb-adcdcc93ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:00 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a72edc7-bca3-4fe7-a866-489a453b1b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a72edc7-bca3-4fe7-a866-489a453b1b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479908813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fe6b79-b821-4be4-87ee-72973902ffe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:01Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72871c8d-783c-4ce9-8408-da9e8f3ad95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72871c8d-783c-4ce9-8408-da9e8f3ad95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ca6f25-e228-47bf-a748-8c0a5144d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ca6f25-e228-47bf-a748-8c0a5144d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fe6b79-b821-4be4-87ee-72973902ffe6', 'volume_name': 'volume-c4fe6b79-b821-4be4-87ee-72973902ffe6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7252428d-16da-4118-889b-d5ade46a03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7252428d-16da-4118-889b-d5ade46a03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317aa3c5-e4aa-40d3-83a8-0d7ef5062fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Volume c4fe6b79-b821-4be4-87ee-72973902ffe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fe6b79-b821-4be4-87ee-72973902ffe6', 'volume_size': 1} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:01 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987" returned: 0 in 0.752s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061654451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b998e3a-e6aa-4bbd-8300-854565d24f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:59Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating volume 1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:01 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:01 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 1073741824 Jul 08 03:50:01 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162c79a-b3e2-4055-808b-df4683bf2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894b39db-0bba-4772-b6d9-beebf7efa987', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d09f747-08eb-407c-b598-227d0bff52e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Volume volume-894b39db-0bba-4772-b6d9-beebf7efa987 (894b39db-0bba-4772-b6d9-beebf7efa987): created successfully Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d09f747-08eb-407c-b598-227d0bff52e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (3144e4e1-4def-4a6b-91c3-80bea7fd6097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a157d777-ad87-4866-b9b8-d553d7133239 tempest-CreateVolumesFromImageTest-1183558189 None] Created volume successfully. Jul 08 03:50:02 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 1073741824" returned: 0 in 0.938s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:02 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 Jul 08 03:50:02 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:02 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08" returned: 0 in 0.694s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.046s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348342622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89a4b91-a993-4690-bce2-2aedcbe1e271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:49:59Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Creating volume f89a4b91-a993-4690-bce2-2aedcbe1e271 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:02 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:02 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 1073741824 Jul 08 03:50:02 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3b0785-40cb-4afb-918f-ee3f93ab95be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b998e3a-e6aa-4bbd-8300-854565d24f08', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd350f83-671f-4090-9676-1a110c839a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:02 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 (1b998e3a-e6aa-4bbd-8300-854565d24f08): created successfully Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd350f83-671f-4090-9676-1a110c839a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:02 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (f780a569-2fc9-47ce-9ed7-3d50096da54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d5e83f7d-a294-4bd5-bdc5-1a7dac5925fc tempest-CreateVolumesFromSnapshotTest-945095075 None] Created volume successfully. Jul 08 03:50:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:03 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 1073741824" returned: 0 in 1.065s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:03 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 Jul 08 03:50:03 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Flow 'volume_create_manager' (d592ca9c-2aa6-4719-8f94-31770aeadd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a702c1f-5402-4f7e-81cf-4c6975d04500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a702c1f-5402-4f7e-81cf-4c6975d04500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5438be-4076-471a-9d85-f9158cb63e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5eb85feb734691b7f87e2e16f549df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:04Z,use_quota=True,user_id='24fe6882792a4defb22c92471465c30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e0893bc-73f6-44f1-80d2-c57e7cbbcc19),volume_type_id=4e0893bc-73f6-44f1-80d2-c57e7cbbcc19)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a493ebb7-e822-413c-b548-304f62ae1510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a493ebb7-e822-413c-b548-304f62ae1510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be0d4f8-0f5e-4d69-91df-ea0bcf350b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:50:04 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271" returned: 0 in 0.697s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.474s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482043639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614f082d-3c77-4ec9-84ce-b6b499092d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:00Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Creating volume 614f082d-3c77-4ec9-84ce-b6b499092d39 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:04 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:04 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 1073741824 Jul 08 03:50:04 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef577b80-dfbe-4bbb-952f-6e7641f28317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89a4b91-a993-4690-bce2-2aedcbe1e271', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885710a-0a48-4096-b950-c5510930d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:04 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Volume volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 (f89a4b91-a993-4690-bce2-2aedcbe1e271): created successfully Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3885710a-0a48-4096-b950-c5510930d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (328b62f6-61d2-44ba-ab2e-339444191ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-43105431-3f53-4e5c-b269-02cc9dfd4432 tempest-CreateVolumesFromImageTest-1183558189 None] Created volume successfully. Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be0d4f8-0f5e-4d69-91df-ea0bcf350b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd5438be-4076-471a-9d85-f9158cb63e1f', 'volume_name': 'volume-bd5438be-4076-471a-9d85-f9158cb63e1f', 'volume_size': 1, 'image_id': '92c949ae-ec81-4afa-9568-86b447be2013', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92c949ae-ec81-4afa-9568-86b447be2013', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a79ef89a216c290c47a725308c29694', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be5eb85feb734691b7f87e2e16f549df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c76dff8c8e6c895766fe9441ca7955330a7dfec1d381dd13ac45de421dcf8521b3ccb4c4cf71a0127684bd80136855f5f31b7edeba66b53bf60ad2b730e33df', 'id': '92c949ae-ec81-4afa-9568-86b447be2013', 'created_at': datetime.datetime(2026, 7, 8, 1, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 50, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92c949ae-ec81-4afa-9568-86b447be2013/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f61e0ca-ec94-40a5-94b7-fa96aa7cfe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f61e0ca-ec94-40a5-94b7-fa96aa7cfe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28be8528-1ea6-401e-94fc-9059fa7579f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:04 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Volume bd5438be-4076-471a-9d85-f9158cb63e1f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd5438be-4076-471a-9d85-f9158cb63e1f', 'volume_size': 1, 'image_id': '92c949ae-ec81-4afa-9568-86b447be2013', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92c949ae-ec81-4afa-9568-86b447be2013', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a79ef89a216c290c47a725308c29694', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be5eb85feb734691b7f87e2e16f549df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c76dff8c8e6c895766fe9441ca7955330a7dfec1d381dd13ac45de421dcf8521b3ccb4c4cf71a0127684bd80136855f5f31b7edeba66b53bf60ad2b730e33df', 'id': '92c949ae-ec81-4afa-9568-86b447be2013', 'created_at': datetime.datetime(2026, 7, 8, 1, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 50, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92c949ae-ec81-4afa-9568-86b447be2013/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 03:50:04 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Trying to clone bd5438be-4076-471a-9d85-f9158cb63e1f from image 92c949ae-ec81-4afa-9568-86b447be2013 at location (None, [{'url': 'file:///opt/stack/data/glance/images/92c949ae-ec81-4afa-9568-86b447be2013', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:50:05 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Image download 0.00 MB at 0.00 MB/s Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27c7c5d-0ead-4081-a299-64b6b78281f2]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:05 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD Jul 08 03:50:05 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:05 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 1073741824" returned: 0 in 0.904s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:05 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 Jul 08 03:50:05 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:05 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:06 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD Jul 08 03:50:06 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:06 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.483s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422192988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c423bf28-1580-4aa1-9d59-89aef0d5a8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:01Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Creating volume c423bf28-1580-4aa1-9d59-89aef0d5a8d6 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:06 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:06 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 1073741824 Jul 08 03:50:06 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23f222c-649c-41c9-bd2a-26b5046028a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614f082d-3c77-4ec9-84ce-b6b499092d39', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e2a16f-db7e-4df8-bb51-00f0ef58e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:06 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Volume volume-614f082d-3c77-4ec9-84ce-b6b499092d39 (614f082d-3c77-4ec9-84ce-b6b499092d39): created successfully Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e2a16f-db7e-4df8-bb51-00f0ef58e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (ab77ca75-ab49-4138-8722-109b2123732b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3e0a1513-4641-41fa-a23b-cba45216b1bc tempest-CreateVolumesFromImageTest-1183558189 None] Created volume successfully. Jul 08 03:50:06 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Temporary image 92c949ae-ec81-4afa-9568-86b447be2013 is fetched for user 24fe6882792a4defb22c92471465c30c. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3373b407-7b21-442f-a9c0-ed8f22b2af17]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:06 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD Jul 08 03:50:06 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:07 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 1073741824" returned: 0 in 0.925s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:07 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 Jul 08 03:50:07 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:07 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:07 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD Jul 08 03:50:07 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:08 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6" returned: 0 in 0.793s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.973s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-479908813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fe6b79-b821-4be4-87ee-72973902ffe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2113c17208a4e6cbf89f69f211eb741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:01Z,use_quota=True,user_id='881bc857bb5a46d6b2915326763750c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Creating volume c4fe6b79-b821-4be4-87ee-72973902ffe6 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:08 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b906d8c8-5e9d-4a53-97eb-90342a52ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:08 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 1073741824 Jul 08 03:50:08 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51232c4-de86-4bb0-80a5-22622fd38cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:08 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Volume volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 (c423bf28-1580-4aa1-9d59-89aef0d5a8d6): created successfully Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51232c4-de86-4bb0-80a5-22622fd38cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (07e493e1-5afe-471a-82fe-1eb5892177b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7aaf344a-b24d-40f4-93c9-6c21ad2b9883 tempest-CreateVolumesFromImageTest-1183558189 None] Created volume successfully. Jul 08 03:50:08 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:08 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 1073741824" returned: 0 in 0.923s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:09 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 Jul 08 03:50:09 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:09 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6" returned: 0 in 0.660s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.217s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317aa3c5-e4aa-40d3-83a8-0d7ef5062fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fe6b79-b821-4be4-87ee-72973902ffe6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f146e34-8ab2-46a9-88c2-7e45704a81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating offline snapshot 638af668-738c-441a-ba04-5a675e88eee0 of volume 1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:50:09 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Volume volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 (c4fe6b79-b821-4be4-87ee-72973902ffe6): created successfully Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f146e34-8ab2-46a9-88c2-7e45704a81f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Flow 'volume_create_manager' (20bf4df4-ee22-4883-a1bb-adcdcc93ea73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de95e3a-6fc0-4044-a735-e57cb14805a7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:09 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-54ec3be7-2a87-458c-b820-ecfd9e821e82 tempest-CreateVolumesFromImageTest-1183558189 None] Created volume successfully. Jul 08 03:50:09 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 Jul 08 03:50:09 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:10 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08" returned: 0 in 0.809s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:10 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 1G Jul 08 03:50:10 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-c4fe6b79-b821-4be4-87ee-72973902ffe6-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-c4fe6b79-b821-4be4-87ee-72973902ffe6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-quobyte-c4fe6b79-b821-4be4-87ee-72973902ffe6" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-c4fe6b79-b821-4be4-87ee-72973902ffe6" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7afc606-15b8-460d-8242-dcc2cbc6d6e1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:11 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 Jul 08 03:50:11 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:11 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 1G" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:11 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 Jul 08 03:50:11 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:11 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6" returned: 0 in 0.874s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:11 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6 Jul 08 03:50:11 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:12 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0" returned: 0 in 0.756s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:12 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 is being set with open permissions: ugo+rw Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:12 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 Jul 08 03:50:12 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:12 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c4fe6b79-b821-4be4-87ee-72973902ffe6" returned: 0 in 0.691s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-c4fe6b79-b821-4be4-87ee-72973902ffe6" released by "delete_volume" :: held 1.617s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Created reservations ['24bb2288-2b90-48fc-89b5-fd547a7ddf5b', '9e021739-7a42-4a0f-b76a-340d887f1885', 'b7c4a8c4-6e29-4aa6-9008-6cb80827fca7', '31dd71f7-da5f-454e-a0f8-4bf719a005b9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:12 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:12 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:12 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0" returned: 0 in 0.682s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:12 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info Jul 08 03:50:12 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-c423bf28-1580-4aa1-9d59-89aef0d5a8d6-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-c423bf28-1580-4aa1-9d59-89aef0d5a8d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-quobyte-c423bf28-1580-4aa1-9d59-89aef0d5a8d6" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-c423bf28-1580-4aa1-9d59-89aef0d5a8d6" acquired by "delete_volume" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475a8e2-9ab9-40e1-ae81-1fd34ee65e95]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:13 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.692s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Deleted volume successfully. Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e0f285e-e746-47bd-a826-d969ff6d945a tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-c4fe6b79-b821-4be4-87ee-72973902ffe6-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:13 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 Jul 08 03:50:13 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:13 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info" returned: 0 in 0.815s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:13 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info is being set with open permissions: ugo+rw Jul 08 03:50:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:13 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info Jul 08 03:50:13 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:14 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6" returned: 0 in 0.879s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:14 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6 Jul 08 03:50:14 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:14 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.info" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.766s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.138s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5438be-4076-471a-9d85-f9158cb63e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5eb85feb734691b7f87e2e16f549df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:04Z,use_quota=True,user_id='24fe6882792a4defb22c92471465c30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e0893bc-73f6-44f1-80d2-c57e7cbbcc19),volume_type_id=4e0893bc-73f6-44f1-80d2-c57e7cbbcc19)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Creating volume bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:14 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:14 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f 1073741824 Jul 08 03:50:14 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-18051b43-7e61-475d-9c3e-802f7fa80378 tempest-CreateVolumesFromSnapshotTest-945095075 None] Create snapshot completed successfully Jul 08 03:50:14 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-c423bf28-1580-4aa1-9d59-89aef0d5a8d6" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-c423bf28-1580-4aa1-9d59-89aef0d5a8d6" released by "delete_volume" :: held 1.624s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Created reservations ['699ed284-4874-45a7-b650-e1e625378d92', 'd659cbc2-d65c-48c5-804c-289dd3ab755c', '7f49d48b-171e-41a1-a5d9-d43264d4a7f8', '0e48cfe0-8e06-4915-8ecb-43d62a3df850'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:15 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:15 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-614f082d-3c77-4ec9-84ce-b6b499092d39-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-614f082d-3c77-4ec9-84ce-b6b499092d39-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:15 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f 1073741824" returned: 0 in 1.117s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-quobyte-614f082d-3c77-4ec9-84ce-b6b499092d39" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-614f082d-3c77-4ec9-84ce-b6b499092d39" acquired by "delete_volume" :: waited 0.038s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d75609-11bc-483e-8c33-f7039bf2c194]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:15 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:15 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (663dca8a-3c53-4956-ab01-5f963160ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4f7f66-74dd-40e7-b48b-9b1c2491d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4f7f66-74dd-40e7-b48b-9b1c2491d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2106329942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cac07d1-3bf3-445f-8cd5-b32a29cfef72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:16Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5e8528-d534-4762-b4ba-e24aaad134c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5e8528-d534-4762-b4ba-e24aaad134c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc33353-123a-4774-aad9-6f3f9d20ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc33353-123a-4774-aad9-6f3f9d20ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cac07d1-3bf3-445f-8cd5-b32a29cfef72', 'volume_name': 'volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:15 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 Jul 08 03:50:15 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03fac48-a625-4580-9e65-eb7c6d056650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03fac48-a625-4580-9e65-eb7c6d056650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd25b814-c3aa-4047-9819-42d2da7dea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:15 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume 0cac07d1-3bf3-445f-8cd5-b32a29cfef72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72', 'volume_size': 1} Jul 08 03:50:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:16 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.009s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Deleted volume successfully. Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-be553cd7-c378-4206-8aae-f0e138238980 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-c423bf28-1580-4aa1-9d59-89aef0d5a8d6-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (8ff909cd-b1c1-4ff7-8ba7-83b7da04cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0508a0d0-2796-468b-a79e-bdc66cdf5318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0508a0d0-2796-468b-a79e-bdc66cdf5318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434360936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e309e5f-c2b4-4ddc-8baa-849cbbe7560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:16Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b729489e-c081-4f69-8c85-a03694bb4662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b729489e-c081-4f69-8c85-a03694bb4662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ca805-0da6-4f19-9d22-20d2963db4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ca805-0da6-4f19-9d22-20d2963db4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e309e5f-c2b4-4ddc-8baa-849cbbe7560c', 'volume_name': 'volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d056ebd9-5924-4ac5-a230-82e40ec3248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d056ebd9-5924-4ac5-a230-82e40ec3248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7127c3-b82c-48db-acf2-7f1c0fb74ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume 4e309e5f-c2b4-4ddc-8baa-849cbbe7560c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c', 'volume_size': 1} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:16 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 0 in 1.024s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2106329942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cac07d1-3bf3-445f-8cd5-b32a29cfef72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:16Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating volume 0cac07d1-3bf3-445f-8cd5-b32a29cfef72 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:16 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:16 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 1073741824 Jul 08 03:50:16 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Attempting download of 92c949ae-ec81-4afa-9568-86b447be2013 ((None, [{'url': 'file:///opt/stack/data/glance/images/92c949ae-ec81-4afa-9568-86b447be2013', 'metadata': {}}])) to volume bd5438be-4076-471a-9d85-f9158cb63e1f. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:16 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (0229f293-c5f5-43b7-9e60-8fa746382151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df1f4c9-24e0-4b82-828d-03aec805908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39" returned: 0 in 1.232s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:17 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39 Jul 08 03:50:17 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df1f4c9-24e0-4b82-828d-03aec805908e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986205663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d47ade-f9de-43c1-82d5-930b60cfc7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:17Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d57733-2858-45d9-9714-0a3396f0ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d57733-2858-45d9-9714-0a3396f0ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbdef5e-c292-4306-98b9-684da9603f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbdef5e-c292-4306-98b9-684da9603f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d47ade-f9de-43c1-82d5-930b60cfc7dc', 'volume_name': 'volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98a651c-0d4b-49d7-a82c-ce807625f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98a651c-0d4b-49d7-a82c-ce807625f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764424a1-1aec-47fa-9e4c-a18005d788b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume 66d47ade-f9de-43c1-82d5-930b60cfc7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc', 'volume_size': 1} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c18701-5a52-4a4d-baf6-a817417439bd]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:17 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2 Jul 08 03:50:17 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (b307f833-709a-42b9-b811-bae4ac3ac43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5945d4-5c97-4075-93a3-f7a993ad00e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5945d4-5c97-4075-93a3-f7a993ad00e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-776354281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2345bfc3-d543-4daf-b634-d640f58a9cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:17Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4709f1a0-9293-4d64-9cff-78ba61144691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4709f1a0-9293-4d64-9cff-78ba61144691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d79ecc-0976-4e1e-b36a-d0b67f2e7fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d79ecc-0976-4e1e-b36a-d0b67f2e7fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2345bfc3-d543-4daf-b634-d640f58a9cb1', 'volume_name': 'volume-2345bfc3-d543-4daf-b634-d640f58a9cb1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ea4f35-05c4-44ea-a582-05be760f2ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ea4f35-05c4-44ea-a582-05be760f2ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af13fb27-d461-4165-9e45-3f0a2a4616f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume 2345bfc3-d543-4daf-b634-d640f58a9cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2345bfc3-d543-4daf-b634-d640f58a9cb1', 'volume_size': 1} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (852bdab7-9862-4e9e-99de-24fad93b7cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2ac30f-a836-4c9a-b128-c0573418beec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:18 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 1073741824" returned: 0 in 1.233s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2ac30f-a836-4c9a-b128-c0573418beec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732574355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2eecd6-8992-473f-88d5-042afeb647da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:18Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d22b17f-3c20-491c-907c-e7cc692eef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d22b17f-3c20-491c-907c-e7cc692eef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e066b9c-6144-444b-b563-02f0fd5d297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e066b9c-6144-444b-b563-02f0fd5d297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2eecd6-8992-473f-88d5-042afeb647da', 'volume_name': 'volume-0b2eecd6-8992-473f-88d5-042afeb647da', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:18 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4dd38b-99e3-4aee-9e5c-7b7918f45f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4dd38b-99e3-4aee-9e5c-7b7918f45f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dbba05-da81-42b6-8e9c-8b90645c077d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:18 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume 0b2eecd6-8992-473f-88d5-042afeb647da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2eecd6-8992-473f-88d5-042afeb647da', 'volume_size': 1} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-614f082d-3c77-4ec9-84ce-b6b499092d39" returned: 0 in 1.072s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-614f082d-3c77-4ec9-84ce-b6b499092d39" released by "delete_volume" :: held 2.397s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:18 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 Jul 08 03:50:18 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Created reservations ['16282750-18eb-4abc-92cb-54c14ea647ec', '339bd945-951f-4a11-a0b4-4b756883a84a', 'e644e9dd-8fe9-453d-aa64-b6e4563e925e', '8194d3c5-0ae5-4061-a21e-3879182e7150'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:18 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:18 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:18 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2" returned: 0 in 1.237s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:18 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2 Jul 08 03:50:18 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:18 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72" returned: 0 in 0.878s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434360936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e309e5f-c2b4-4ddc-8baa-849cbbe7560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:16Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating volume 4e309e5f-c2b4-4ddc-8baa-849cbbe7560c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:19 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:19 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.807s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:19 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c 1073741824 Jul 08 03:50:19 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Deleted volume successfully. Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd25b814-c3aa-4047-9819-42d2da7dea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff2c6db-8b90-4fdb-b32e-44bf2ad8c4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-f89a4b91-a993-4690-bce2-2aedcbe1e271-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1a374bdf-2528-40ff-bfc4-40184ea77c93 tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-614f082d-3c77-4ec9-84ce-b6b499092d39-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:19 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 (0cac07d1-3bf3-445f-8cd5-b32a29cfef72): created successfully Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff2c6db-8b90-4fdb-b32e-44bf2ad8c4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (663dca8a-3c53-4956-ab01-5f963160ba67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-f89a4b91-a993-4690-bce2-2aedcbe1e271-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ee1450ad-7f70-48f4-b0c1-a91b740ad36a tempest-CreateVolumesFromSnapshotTest-945095075 None] Created volume successfully. Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-quobyte-f89a4b91-a993-4690-bce2-2aedcbe1e271" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-f89a4b91-a993-4690-bce2-2aedcbe1e271" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32336a1-bc0a-4736-aa92-6c1c3f5e1a86]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:19 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2" returned: 1 in 1.020s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92c949ae-ec81-4afa-9568-86b447be2013_c0s7gdy2' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38a227f-4f62-4c02-b24b-af5692273168]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:19 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 Jul 08 03:50:19 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:19 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD Jul 08 03:50:19 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:20 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c 1073741824" returned: 0 in 1.023s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:20 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c Jul 08 03:50:20 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:20 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:20 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD Jul 08 03:50:20 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:20 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271" returned: 0 in 1.043s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:20 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271 Jul 08 03:50:20 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:20 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c" returned: 0 in 0.837s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986205663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d47ade-f9de-43c1-82d5-930b60cfc7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:17Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating volume 66d47ade-f9de-43c1-82d5-930b60cfc7dc {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:20 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7127c3-b82c-48db-acf2-7f1c0fb74ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ece313-1f73-4f52-bd80-d5980cdb8388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:21 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc 1073741824 Jul 08 03:50:21 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:21 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c (4e309e5f-c2b4-4ddc-8baa-849cbbe7560c): created successfully Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ece313-1f73-4f52-bd80-d5980cdb8388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (8ff909cd-b1c1-4ff7-8ba7-83b7da04cc76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1575bc99-3ea8-48f3-85c3-213f6d36996c tempest-CreateVolumesFromSnapshotTest-945095075 None] Created volume successfully. Jul 08 03:50:21 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD" returned: 1 in 0.837s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] 92c949ae-ec81-4afa-9568-86b447be2013 was raw, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:21 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:21 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:21 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f89a4b91-a993-4690-bce2-2aedcbe1e271" returned: 0 in 0.870s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-f89a4b91-a993-4690-bce2-2aedcbe1e271" released by "delete_volume" :: held 1.980s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Created reservations ['aa611a6d-f31d-4e12-8235-6f1ec14d27fe', '90d60719-9562-4e04-aa34-9d9da286a9df', '2fed1e26-5afd-46ac-8be1-4ca129452938', 'a1e777b8-ec1c-42da-8b4d-34efd01d4fe4'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:21 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:21 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:22 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 0 in 1.022s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92c949ae-ec81-4afa-9568-86b447be2013_grvg2h6sdevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:50:22 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:22 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f 1G Jul 08 03:50:22 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:22 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc 1073741824" returned: 0 in 1.218s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:22 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Deleted volume successfully. Jul 08 03:50:22 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc Jul 08 03:50:22 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-867d82f0-9b5c-4efa-b193-ecbfe87436aa tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-f89a4b91-a993-4690-bce2-2aedcbe1e271-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-894b39db-0bba-4772-b6d9-beebf7efa987-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-894b39db-0bba-4772-b6d9-beebf7efa987-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "cinder-quobyte-894b39db-0bba-4772-b6d9-beebf7efa987" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-894b39db-0bba-4772-b6d9-beebf7efa987" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d46322-1c1a-49aa-8c58-00c8e702a2ce]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:22 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 Jul 08 03:50:22 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:22 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f 1G" returned: 0 in 0.846s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:22 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc" returned: 0 in 0.755s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa837d9-08ea-48fa-bbe3-d55465e8b061]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.408s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-776354281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2345bfc3-d543-4daf-b634-d640f58a9cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:17Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating volume 2345bfc3-d543-4daf-b634-d640f58a9cb1 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:23 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:23 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 1073741824 Jul 08 03:50:23 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764424a1-1aec-47fa-9e4c-a18005d788b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2be1a1-4af2-4432-8a3d-cb4655b5da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:23 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc (66d47ade-f9de-43c1-82d5-930b60cfc7dc): created successfully Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2be1a1-4af2-4432-8a3d-cb4655b5da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (0229f293-c5f5-43b7-9e60-8fa746382151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:23 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-65602186-e7c3-443c-9f05-f12de7668355 tempest-CreateVolumesFromSnapshotTest-945095075 None] Created volume successfully. Jul 08 03:50:23 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:23 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:23 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987" returned: 0 in 1.006s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:23 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987 Jul 08 03:50:23 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:24 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 0 in 1.028s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:24 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 1073741824" returned: 0 in 1.070s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:24 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 Jul 08 03:50:24 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:24 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:24 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:24 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-894b39db-0bba-4772-b6d9-beebf7efa987" returned: 0 in 0.819s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-quobyte-894b39db-0bba-4772-b6d9-beebf7efa987" released by "delete_volume" :: held 1.895s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Created reservations ['ac76dc84-f2d3-400d-a1f7-5425b3715d3a', '041a465d-d0c3-4114-b88e-79025b737bbb', '1521e95a-b5d4-4b35-9957-d66d6856be62', '14cda542-718e-479b-a742-42a278334807'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:24 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:24 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:25 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1" returned: 0 in 0.964s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.024s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732574355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2eecd6-8992-473f-88d5-042afeb647da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2221d15c11bd4f8695434b1a5ee339ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:18Z,use_quota=True,user_id='de681ff843f1401a9fdda9ecc8bf7575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Creating volume 0b2eecd6-8992-473f-88d5-042afeb647da {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:25 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af13fb27-d461-4165-9e45-3f0a2a4616f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2345bfc3-d543-4daf-b634-d640f58a9cb1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:25 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:25 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da 1073741824 Jul 08 03:50:25 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a01e803-2815-4567-8e0d-dffb75439e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 1 in 1.118s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Downloaded image 92c949ae-ec81-4afa-9568-86b447be2013 ((None, [{'url': 'file:///opt/stack/data/glance/images/92c949ae-ec81-4afa-9568-86b447be2013', 'metadata': {}}])) to volume bd5438be-4076-471a-9d85-f9158cb63e1f successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Temporary image 92c949ae-ec81-4afa-9568-86b447be2013 for user 24fe6882792a4defb22c92471465c30c is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Marking volume bd5438be-4076-471a-9d85-f9158cb63e1f as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:50:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 (2345bfc3-d543-4daf-b634-d640f58a9cb1): created successfully Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a01e803-2815-4567-8e0d-dffb75439e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (b307f833-709a-42b9-b811-bae4ac3ac43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Copying metadata from image 92c949ae-ec81-4afa-9568-86b447be2013 to bd5438be-4076-471a-9d85-f9158cb63e1f. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Creating volume glance metadata for volume bd5438be-4076-471a-9d85-f9158cb63e1f backed by image 92c949ae-ec81-4afa-9568-86b447be2013 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '92c949ae-ec81-4afa-9568-86b447be2013', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4a79ef89a216c290c47a725308c29694', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:50:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-49cfb3d7-6845-4242-8cdd-a2fd8757986f tempest-CreateVolumesFromSnapshotTest-945095075 None] Created volume successfully. Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28be8528-1ea6-401e-94fc-9059fa7579f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5438be-4076-471a-9d85-f9158cb63e1f', 'volume_size': 1, 'image_id': '92c949ae-ec81-4afa-9568-86b447be2013', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92c949ae-ec81-4afa-9568-86b447be2013', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a79ef89a216c290c47a725308c29694', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be5eb85feb734691b7f87e2e16f549df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c76dff8c8e6c895766fe9441ca7955330a7dfec1d381dd13ac45de421dcf8521b3ccb4c4cf71a0127684bd80136855f5f31b7edeba66b53bf60ad2b730e33df', 'id': '92c949ae-ec81-4afa-9568-86b447be2013', 'created_at': datetime.datetime(2026, 7, 8, 1, 50, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 50, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92c949ae-ec81-4afa-9568-86b447be2013/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7bb718-5a35-491f-9548-9b7e267bc368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:25 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Volume volume-bd5438be-4076-471a-9d85-f9158cb63e1f (bd5438be-4076-471a-9d85-f9158cb63e1f): created successfully Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7bb718-5a35-491f-9548-9b7e267bc368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Flow 'volume_create_manager' (d592ca9c-2aa6-4719-8f94-31770aeadd9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-23865f95-e7db-487c-ae3e-ee111d384250 tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Created volume successfully. Jul 08 03:50:25 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.936s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Deleted volume successfully. Jul 08 03:50:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b9d71be5-78dc-4bf7-8404-667712a5279b tempest-CreateVolumesFromImageTest-1183558189 None] Lock "cinder-894b39db-0bba-4772-b6d9-beebf7efa987-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Acquiring lock "cinder-bd5438be-4076-471a-9d85-f9158cb63e1f-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:26 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da 1073741824" returned: 0 in 1.257s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "cinder-bd5438be-4076-471a-9d85-f9158cb63e1f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Acquiring lock "cinder-quobyte-bd5438be-4076-471a-9d85-f9158cb63e1f" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "cinder-quobyte-bd5438be-4076-471a-9d85-f9158cb63e1f" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:26 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da Jul 08 03:50:26 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ba93c-98a2-4655-9610-f6e9099082cf]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:26 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:26 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:27 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:27 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 0 in 1.005s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da" returned: 0 in 1.144s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.522s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dbba05-da81-42b6-8e9c-8b90645c077d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2eecd6-8992-473f-88d5-042afeb647da', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9bda55-7252-4a63-af82-618c8123df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Volume volume-0b2eecd6-8992-473f-88d5-042afeb647da (0b2eecd6-8992-473f-88d5-042afeb647da): created successfully Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9bda55-7252-4a63-af82-618c8123df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Flow 'volume_create_manager' (852bdab7-9862-4e9e-99de-24fad93b7cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-19655c16-5330-4b73-b084-58521146109e tempest-CreateVolumesFromSnapshotTest-945095075 None] Created volume successfully. Jul 08 03:50:27 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:27 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-0b2eecd6-8992-473f-88d5-042afeb647da-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-0b2eecd6-8992-473f-88d5-042afeb647da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=95,cinder:UPDATE=135,cinder:INSERT=28,cinder:DELETE=12 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-0b2eecd6-8992-473f-88d5-042afeb647da" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-0b2eecd6-8992-473f-88d5-042afeb647da" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf77f7-dbc0-4f01-8ee2-a7126efc4f61]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:28 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da Jul 08 03:50:28 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:28 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 1 in 1.300s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:50:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:28 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f Jul 08 03:50:28 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:INSERT=35,cinder:UPDATE=115,cinder:DELETE=14,cinder:SELECT=83 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (5a5dda4d-cd70-4c32-9484-39d044329e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9bdb8a-16fa-4a55-8591-4fa3b539632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9bdb8a-16fa-4a55-8591-4fa3b539632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174600290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdd3e5d-b478-496c-be34-d6e5b05b148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:29Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feff9b8d-8d84-4c76-a228-b59e03fe2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feff9b8d-8d84-4c76-a228-b59e03fe2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05e9212-f5f6-4ca2-9de6-84dfdaf45240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05e9212-f5f6-4ca2-9de6-84dfdaf45240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cdd3e5d-b478-496c-be34-d6e5b05b148e', 'volume_name': 'volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c7734-47cb-4a8f-bddf-65287f0eba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:29 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c7734-47cb-4a8f-bddf-65287f0eba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a908ee61-bf12-45e6-bcda-04d45182aa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:29 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume 6cdd3e5d-b478-496c-be34-d6e5b05b148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e', 'volume_size': 1} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174600290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdd3e5d-b478-496c-be34-d6e5b05b148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:29Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Creating volume 6cdd3e5d-b478-496c-be34-d6e5b05b148e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:29 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da" returned: 0 in 1.171s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:29 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e 1073741824 Jul 08 03:50:29 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:29 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da Jul 08 03:50:29 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:29 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bd5438be-4076-471a-9d85-f9158cb63e1f" returned: 0 in 0.964s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "cinder-quobyte-bd5438be-4076-471a-9d85-f9158cb63e1f" released by "delete_volume" :: held 3.382s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:29 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Created reservations ['c238182f-3701-4a7d-8c18-1263a791404d', 'e260d1ff-8e5e-48c4-b547-e73183b0d474', '2def282b-9da9-4ee2-8f34-ee1a161f596f', '8cc3ca81-7794-4f0c-9ab2-e117a31fd2f5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:30 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:30 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:30 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0b2eecd6-8992-473f-88d5-042afeb647da" returned: 0 in 0.872s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-0b2eecd6-8992-473f-88d5-042afeb647da" released by "delete_volume" :: held 2.120s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['54b164f4-d9c0-4289-b05a-468087b435bf', 'fd0dcacd-48ae-40fd-ba19-7dfdc56e6210', '5d4268b6-95a8-48e4-9a3b-20214dd4d1a7', 'e5e37041-f74b-4ae9-bfe2-8c55d236a4bf'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:30 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:30 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:30 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e 1073741824" returned: 0 in 1.243s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:30 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e Jul 08 03:50:30 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:30 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.873s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Deleted volume successfully. Jul 08 03:50:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b7a50726-36b4-4a55-96f9-16e5ee27cfbe tempest-VolumeAndVolumeTypeFromImageTest-1553236772 None] Lock "cinder-bd5438be-4076-471a-9d85-f9158cb63e1f-delete_volume" released by "delete_volume" :: held 4.551s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-2345bfc3-d543-4daf-b634-d640f58a9cb1-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-2345bfc3-d543-4daf-b634-d640f58a9cb1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-2345bfc3-d543-4daf-b634-d640f58a9cb1" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-2345bfc3-d543-4daf-b634-d640f58a9cb1" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:31 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.210s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleted volume successfully. Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d2787-0d87-4fa9-b802-450b0c7b6980]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:31 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-c6229677-f4a3-427e-b52f-b6a8a3b0953c tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-0b2eecd6-8992-473f-88d5-042afeb647da-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:31 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 Jul 08 03:50:31 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:32 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e" returned: 0 in 1.271s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] <== create_volume: return (2603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.609s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a908ee61-bf12-45e6-bcda-04d45182aa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde8cbc8-31a5-4d1f-8e92-9e394460ca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:32 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e (6cdd3e5d-b478-496c-be34-d6e5b05b148e): created successfully Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde8cbc8-31a5-4d1f-8e92-9e394460ca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (5a5dda4d-cd70-4c32-9484-39d044329e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d4895cb7-2b5f-4dcf-bde4-a59218c2e68a tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created volume successfully. Jul 08 03:50:32 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1" returned: 0 in 0.862s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:32 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1 Jul 08 03:50:32 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (bd01f9be-624f-4333-a121-d862c8754ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512cbf09-52b3-422e-84ff-036c6d894ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512cbf09-52b3-422e-84ff-036c6d894ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293288739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a80a08-9378-4237-96fb-ca10c136029a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:33Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11206916-bdbb-4da9-89b0-c6e8a68a6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11206916-bdbb-4da9-89b0-c6e8a68a6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd210c4-aa31-4f3c-a70e-9607166e846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd210c4-aa31-4f3c-a70e-9607166e846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a80a08-9378-4237-96fb-ca10c136029a', 'volume_name': 'volume-05a80a08-9378-4237-96fb-ca10c136029a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56c13fd-5acd-49cd-9e7a-93504533a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56c13fd-5acd-49cd-9e7a-93504533a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbccc9c0-6b8d-4d65-9541-9c9e5cc122a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:33 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume 05a80a08-9378-4237-96fb-ca10c136029a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a80a08-9378-4237-96fb-ca10c136029a', 'volume_size': 1} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293288739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a80a08-9378-4237-96fb-ca10c136029a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:33Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Creating volume 05a80a08-9378-4237-96fb-ca10c136029a {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:33 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:33 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a 1073741824 Jul 08 03:50:33 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (7921c36a-bb1c-4aca-877e-839285871625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f5b1f1-22a8-4261-85d4-e8c752db1027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f5b1f1-22a8-4261-85d4-e8c752db1027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1583040437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e266999-c456-49dd-b810-f6d5d6910c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:34Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6e2d9b-38f1-4fff-99b0-d651ca9e6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6e2d9b-38f1-4fff-99b0-d651ca9e6637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca437259-89a7-404f-9df7-2e8443c0c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca437259-89a7-404f-9df7-2e8443c0c392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e266999-c456-49dd-b810-f6d5d6910c08', 'volume_name': 'volume-5e266999-c456-49dd-b810-f6d5d6910c08', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd3dc28-ac26-4b65-a230-f8072aaae831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd3dc28-ac26-4b65-a230-f8072aaae831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f03c8e-6484-470f-8441-55ba70308952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume 5e266999-c456-49dd-b810-f6d5d6910c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e266999-c456-49dd-b810-f6d5d6910c08', 'volume_size': 1} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2345bfc3-d543-4daf-b634-d640f58a9cb1" returned: 0 in 1.394s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-2345bfc3-d543-4daf-b634-d640f58a9cb1" released by "delete_volume" :: held 2.347s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['d1959f0d-8203-452f-b924-23e9ae49fcf5', '45ea0a09-0250-41e7-930c-8c041562c813', '6b1df733-1f06-41e4-a133-802df0bc8eb3', '1271665e-30cd-435f-87d5-df29c7131c71'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:34 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:34 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (f2019cf5-0224-45c3-96f1-9ecd47e93516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab338d8-281d-4480-a234-426c7f87dff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab338d8-281d-4480-a234-426c7f87dff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-68553558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51b16ec-9b8b-4a9d-a822-25966b6734f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:34Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7a4a38-9cfe-4014-947d-0a2fe5d97f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7a4a38-9cfe-4014-947d-0a2fe5d97f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c510c220-b5d7-48f3-ab79-037946d81dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c510c220-b5d7-48f3-ab79-037946d81dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51b16ec-9b8b-4a9d-a822-25966b6734f1', 'volume_name': 'volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cc1759-8b80-4ebb-91b6-ac09b5cef6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cc1759-8b80-4ebb-91b6-ac09b5cef6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd1331e-afcb-4d4e-8c53-0eff81f889f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume a51b16ec-9b8b-4a9d-a822-25966b6734f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1', 'volume_size': 1} Jul 08 03:50:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:35 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a 1073741824" returned: 0 in 1.717s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:35 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-66d47ade-f9de-43c1-82d5-930b60cfc7dc-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.902s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:35 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:35 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleted volume successfully. Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-66d47ade-f9de-43c1-82d5-930b60cfc7dc-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-29749aee-5041-47ce-85ae-908b61f2c749 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-2345bfc3-d543-4daf-b634-d640f58a9cb1-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (c1136a2e-21b8-458a-ad1f-1e2161a88a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6187acfc-19fe-4951-94fa-de365cd255dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-66d47ade-f9de-43c1-82d5-930b60cfc7dc" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6187acfc-19fe-4951-94fa-de365cd255dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381717131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7650b7-8c8f-4dc2-963f-de8a8a7b8702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:35Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e6b6fc-019c-457b-a6ec-c580e407b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e6b6fc-019c-457b-a6ec-c580e407b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19224ed2-16fb-4bd1-b324-62f69897486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19224ed2-16fb-4bd1-b324-62f69897486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be7650b7-8c8f-4dc2-963f-de8a8a7b8702', 'volume_name': 'volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0d480f-3d83-483e-adc6-56c4ecd4d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0d480f-3d83-483e-adc6-56c4ecd4d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181ae629-40dc-42a8-aefb-03b7013652ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:35 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume be7650b7-8c8f-4dc2-963f-de8a8a7b8702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702', 'volume_size': 1} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-66d47ade-f9de-43c1-82d5-930b60cfc7dc" acquired by "delete_volume" :: waited 0.146s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7968f19e-8231-423c-9e7f-b73a2f60edf0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:35 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc Jul 08 03:50:35 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (966cd3f8-ecdf-4cdd-bbc1-b18a84c94e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:35 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29bbb07-d91b-4aaa-84ec-44c673e2b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29bbb07-d91b-4aaa-84ec-44c673e2b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834649118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2219c3f7-b317-4641-b153-21ddd6761b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:36Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b97ebd0-8906-4c07-bf8f-efc4df7a1eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b97ebd0-8906-4c07-bf8f-efc4df7a1eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b6bfab-48a4-4a75-9b09-4313916bad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b6bfab-48a4-4a75-9b09-4313916bad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2219c3f7-b317-4641-b153-21ddd6761b09', 'volume_name': 'volume-2219c3f7-b317-4641-b153-21ddd6761b09', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45327c05-3748-4a8d-abc7-9d2835893b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45327c05-3748-4a8d-abc7-9d2835893b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b28ce5d-97b8-45ff-b644-1f0cba449ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume 2219c3f7-b317-4641-b153-21ddd6761b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2219c3f7-b317-4641-b153-21ddd6761b09', 'volume_size': 1} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:36 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a" returned: 0 in 1.036s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] <== create_volume: return (2861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.866s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1583040437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e266999-c456-49dd-b810-f6d5d6910c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:34Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Creating volume 5e266999-c456-49dd-b810-f6d5d6910c08 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:36 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbccc9c0-6b8d-4d65-9541-9c9e5cc122a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a80a08-9378-4237-96fb-ca10c136029a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c308d3-f999-411c-974f-9a4d484a227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:36 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 1073741824 Jul 08 03:50:36 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume volume-05a80a08-9378-4237-96fb-ca10c136029a (05a80a08-9378-4237-96fb-ca10c136029a): created successfully Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c308d3-f999-411c-974f-9a4d484a227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (bd01f9be-624f-4333-a121-d862c8754ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:36 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-06ffd66c-c791-4e87-9028-207503853b02 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created volume successfully. Jul 08 03:50:36 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc" returned: 0 in 0.993s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:36 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc Jul 08 03:50:36 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:37 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 1073741824" returned: 0 in 1.056s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:37 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 Jul 08 03:50:37 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:37 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-66d47ade-f9de-43c1-82d5-930b60cfc7dc" returned: 0 in 0.912s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-66d47ade-f9de-43c1-82d5-930b60cfc7dc" released by "delete_volume" :: held 1.976s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['16d8a04b-4a85-4d46-9a22-5cfd6cced626', 'c223ba87-e7ec-4977-a246-fe3660fe6874', 'f36f949e-2f1b-47e7-836b-5b9978d4e7ad', '1da2fb07-98ff-4194-92f0-73d3f3269ef9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:37 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:37 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:38 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08" returned: 0 in 1.037s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.603s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-68553558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51b16ec-9b8b-4a9d-a822-25966b6734f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:34Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Creating volume a51b16ec-9b8b-4a9d-a822-25966b6734f1 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:38 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 1073741824 Jul 08 03:50:38 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f03c8e-6484-470f-8441-55ba70308952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e266999-c456-49dd-b810-f6d5d6910c08', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd9e387-611d-4a86-a8e4-9e67423cfbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume volume-5e266999-c456-49dd-b810-f6d5d6910c08 (5e266999-c456-49dd-b810-f6d5d6910c08): created successfully Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd9e387-611d-4a86-a8e4-9e67423cfbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (7921c36a-bb1c-4aca-877e-839285871625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-abdd9333-8631-459a-87b1-862b461e2762 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created volume successfully. Jul 08 03:50:38 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.856s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleted volume successfully. Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f0088c3a-c5f8-44d2-b3bd-83b64b948051 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-66d47ade-f9de-43c1-82d5-930b60cfc7dc-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f3f7e-bfc5-4d4f-8cd5-263ebf76ffea]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:39 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c Jul 08 03:50:39 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:39 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 1073741824" returned: 0 in 1.160s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:39 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 Jul 08 03:50:39 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:39 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c" returned: 0 in 0.865s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:39 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c Jul 08 03:50:39 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:40 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c" returned: 0 in 0.796s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c" released by "delete_volume" :: held 1.722s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:40 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1" returned: 0 in 0.972s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.968s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381717131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7650b7-8c8f-4dc2-963f-de8a8a7b8702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:35Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Creating volume be7650b7-8c8f-4dc2-963f-de8a8a7b8702 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:40 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd1331e-afcb-4d4e-8c53-0eff81f889f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:40 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 1073741824 Jul 08 03:50:40 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e676e90-9ea2-4c6a-9645-60f42e4d9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:40 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 (a51b16ec-9b8b-4a9d-a822-25966b6734f1): created successfully Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e676e90-9ea2-4c6a-9645-60f42e4d9b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (f2019cf5-0224-45c3-96f1-9ecd47e93516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a0c3e277-4523-4cd2-b925-c513eb6ed5a5 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created volume successfully. Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['50d052ce-a10d-4eb8-938d-e7db2f09788a', 'badf24da-5989-41fa-a958-fd714638423c', '8a273cea-1143-4b66-a4de-bc2d2f9281e2', '497fcaef-7ad1-4ea5-9cf7-14cda3b679f7'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:40 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:40 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-0cac07d1-3bf3-445f-8cd5-b32a29cfef72-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-0cac07d1-3bf3-445f-8cd5-b32a29cfef72-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-0cac07d1-3bf3-445f-8cd5-b32a29cfef72" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-0cac07d1-3bf3-445f-8cd5-b32a29cfef72" acquired by "delete_volume" :: waited 0.033s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:41 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb38e3-f9f9-47ae-865e-12e9af9d7586]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:41 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 Jul 08 03:50:41 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:42 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.294s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleted volume successfully. Jul 08 03:50:42 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 1073741824" returned: 0 in 1.614s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fb1f943-ee76-402a-ab3b-5e445b0be36b tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-4e309e5f-c2b4-4ddc-8baa-849cbbe7560c-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:42 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 Jul 08 03:50:42 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:42 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72" returned: 0 in 1.292s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:42 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72 Jul 08 03:50:42 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:43 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702" returned: 0 in 0.914s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] <== create_volume: return (2610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.157s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834649118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2219c3f7-b317-4641-b153-21ddd6761b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa8aeb795c422b98abc48c4f669696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:36Z,use_quota=True,user_id='e0df6575a89c4686a4a9a70a036eae68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Creating volume 2219c3f7-b317-4641-b153-21ddd6761b09 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:43 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181ae629-40dc-42a8-aefb-03b7013652ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8e4743-6a21-4840-9286-6e2ae9a753b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:43 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 1073741824 Jul 08 03:50:43 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:43 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 (be7650b7-8c8f-4dc2-963f-de8a8a7b8702): created successfully Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8e4743-6a21-4840-9286-6e2ae9a753b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (c1136a2e-21b8-458a-ad1f-1e2161a88a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4ee72a9c-7330-4673-b24f-09b0fc3e1c9b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created volume successfully. Jul 08 03:50:43 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0cac07d1-3bf3-445f-8cd5-b32a29cfef72" returned: 0 in 1.128s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-0cac07d1-3bf3-445f-8cd5-b32a29cfef72" released by "delete_volume" :: held 2.532s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['3fe58b3e-36df-4027-b857-cd4df8c67061', '84f31865-68c2-4e82-ac61-e1975b7b29e0', 'b819c700-ce10-46e9-9385-33f19f121de6', '803e0489-8d12-4e76-bdc9-9643e1cb1c3b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:44 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:44 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:44 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 1073741824" returned: 0 in 1.140s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:44 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 Jul 08 03:50:44 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-638af668-738c-441a-ba04-5a675e88eee0-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-638af668-738c-441a-ba04-5a675e88eee0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-1b998e3a-e6aa-4bbd-8300-854565d24f08" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-1b998e3a-e6aa-4bbd-8300-854565d24f08" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-638af668-738c-441a-ba04-5a675e88eee0" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-638af668-738c-441a-ba04-5a675e88eee0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleting offline snapshot 638af668-738c-441a-ba04-5a675e88eee0 of volume 1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:50:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] snapshot_file for this snap is: volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb71fc-ae9f-4507-a8c2-cbcd41762226]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:45 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 1.024s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleted volume successfully. Jul 08 03:50:45 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 Jul 08 03:50:45 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-96dd28a6-6900-4600-b04e-c3a25f9b4832 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-0cac07d1-3bf3-445f-8cd5-b32a29cfef72-delete_volume" released by "delete_volume" :: held 3.932s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:45 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09" returned: 0 in 0.969s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b28ce5d-97b8-45ff-b644-1f0cba449ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2219c3f7-b317-4641-b153-21ddd6761b09', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9c2c73-cf18-4e38-82b9-e2e622d2c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:45 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Volume volume-2219c3f7-b317-4641-b153-21ddd6761b09 (2219c3f7-b317-4641-b153-21ddd6761b09): created successfully Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9c2c73-cf18-4e38-82b9-e2e622d2c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Flow 'volume_create_manager' (966cd3f8-ecdf-4cdd-bbc1-b18a84c94e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-03481e80-cc79-46cc-906a-40d3a0b8b87b tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created volume successfully. Jul 08 03:50:46 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0" returned: 0 in 0.995s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b998e3a-e6aa-4bbd-8300-854565d24f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4729f755-b787-4b33-b805-3a58713f8473]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:46 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 Jul 08 03:50:46 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-2219c3f7-b317-4641-b153-21ddd6761b09-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-2219c3f7-b317-4641-b153-21ddd6761b09-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-quobyte-2219c3f7-b317-4641-b153-21ddd6761b09" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-2219c3f7-b317-4641-b153-21ddd6761b09" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c5957-eb16-43d1-814b-65f62e9c66dc]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:46 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 Jul 08 03:50:46 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:47 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:47 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:47 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08" returned: 0 in 1.044s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:47 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 Jul 08 03:50:47 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (228d04b0-032f-4928-b425-59504812fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf4f94a-d6c0-4858-aa9c-c6f5d3ff18fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf4f94a-d6c0-4858-aa9c-c6f5d3ff18fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1290967285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ead31-ce46-42ae-8b58-29da1bb146f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:47Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a92fa1-5a98-4692-94da-f6aa56ad87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a92fa1-5a98-4692-94da-f6aa56ad87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29868d2c-44c5-42a4-ae30-10e0342c46a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29868d2c-44c5-42a4-ae30-10e0342c46a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9ead31-ce46-42ae-8b58-29da1bb146f0', 'volume_name': 'volume-be9ead31-ce46-42ae-8b58-29da1bb146f0', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7969e6-e0b4-4649-bff6-3f6e7c5bf832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7969e6-e0b4-4649-bff6-3f6e7c5bf832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf2c0cd-b7d8-43cd-8e15-c7367a0527bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:47 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Volume be9ead31-ce46-42ae-8b58-29da1bb146f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9ead31-ce46-42ae-8b58-29da1bb146f0', 'volume_size': 1} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1290967285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9ead31-ce46-42ae-8b58-29da1bb146f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:47Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Creating volume be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:47 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:47 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 1073741824 Jul 08 03:50:47 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:47 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09" returned: 0 in 1.266s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:47 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09 Jul 08 03:50:47 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:47 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.889s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:50:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:50:48 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0" returned: 0 in 0.997s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:48 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0 Jul 08 03:50:48 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:48 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Flow 'volume_create_manager' (f5ae495d-72ac-461c-89ae-c4672e772282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e96342a-9ab1-462d-9baf-759049e21795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 1073741824" returned: 0 in 1.173s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e96342a-9ab1-462d-9baf-759049e21795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1387487668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927257c0-ba2b-480b-8711-0eb7bb9e7cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0af1b556ea54b3086b5253e76b44dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:48Z,use_quota=True,user_id='305a3a9cb26649fb979efd26b345b30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c615a-58f9-4a29-a900-44307424a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c615a-58f9-4a29-a900-44307424a03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746c5862-99f0-4297-9252-b3030aa24147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746c5862-99f0-4297-9252-b3030aa24147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927257c0-ba2b-480b-8711-0eb7bb9e7cbc', 'volume_name': 'volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ec2a7f-99c1-4d70-88de-aa3bb174310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ec2a7f-99c1-4d70-88de-aa3bb174310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e8f036-704e-44de-9cef-ed39f5fd8527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Volume 927257c0-ba2b-480b-8711-0eb7bb9e7cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc', 'volume_size': 1} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:48 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2219c3f7-b317-4641-b153-21ddd6761b09" returned: 0 in 0.873s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-2219c3f7-b317-4641-b153-21ddd6761b09" released by "delete_volume" :: held 2.207s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:48 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 Jul 08 03:50:48 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created reservations ['e09781cb-b671-4726-a394-c621eec824ae', '03abb2af-aa12-4e88-a008-cec16e7c7720', 'feedc264-5584-4e2d-bd82-949a045e7304', '5f7a5d86-a43c-4c13-b95a-e476e970dfbf'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:48 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:48 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:48 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08.638af668-738c-441a-ba04-5a675e88eee0" returned: 0 in 0.718s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-638af668-738c-441a-ba04-5a675e88eee0" released by "_delete_snapshot" :: held 3.871s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-1b998e3a-e6aa-4bbd-8300-854565d24f08" released by "delete_snapshot" :: held 3.897s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['d818b0b3-ad95-4f05-8607-8e1e17bd06b2', 'bb9c0454-3453-46f2-b212-81c055a481f4', '85c38480-e6d8-4078-8cd2-dbe0e0434e49', '7f6e9d84-6f3e-46a3-bff1-b44ef024bb08'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Delete snapshot completed successfully. Jul 08 03:50:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-cb0e3ab3-b28a-439f-ba7c-3c4e9801f811 tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-638af668-738c-441a-ba04-5a675e88eee0-delete_snapshot" released by "delete_snapshot" :: held 4.050s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-1b998e3a-e6aa-4bbd-8300-854565d24f08-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:49 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0" returned: 0 in 0.708s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-1b998e3a-e6aa-4bbd-8300-854565d24f08-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1387487668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927257c0-ba2b-480b-8711-0eb7bb9e7cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0af1b556ea54b3086b5253e76b44dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:48Z,use_quota=True,user_id='305a3a9cb26649fb979efd26b345b30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Creating volume 927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:50:49 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf2c0cd-b7d8-43cd-8e15-c7367a0527bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9ead31-ce46-42ae-8b58-29da1bb146f0', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:49 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc 1073741824 Jul 08 03:50:49 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78951282-67c1-4762-99c9-4aa2966d1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:49 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Volume volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 (be9ead31-ce46-42ae-8b58-29da1bb146f0): created successfully Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78951282-67c1-4762-99c9-4aa2966d1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (228d04b0-032f-4928-b425-59504812fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "cinder-quobyte-1b998e3a-e6aa-4bbd-8300-854565d24f08" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5afeff4b-38ba-4028-ac56-fd42d9b81e2b tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-1b998e3a-e6aa-4bbd-8300-854565d24f08" acquired by "delete_volume" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:49 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced1d53-2928-4869-b2ac-8c231d5f434a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.753s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Deleted volume successfully. Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8b710be8-4a28-40cf-b311-1a42ab4ffb32 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-2219c3f7-b317-4641-b153-21ddd6761b09-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:49 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 Jul 08 03:50:49 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-be7650b7-8c8f-4dc2-963f-de8a8a7b8702-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-be7650b7-8c8f-4dc2-963f-de8a8a7b8702-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-quobyte-be7650b7-8c8f-4dc2-963f-de8a8a7b8702" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-be7650b7-8c8f-4dc2-963f-de8a8a7b8702" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532ef6c-c8d9-43ea-82e4-f82da588c6db]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:49 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 Jul 08 03:50:49 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:50 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc 1073741824" returned: 0 in 0.886s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:50 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:50:50 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:50 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:50 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08 Jul 08 03:50:50 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:50 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702" returned: 0 in 0.868s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:50 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702 Jul 08 03:50:50 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:50 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.805s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.305s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Creating offline snapshot ecf0b2ab-d06d-49e0-9937-bc742ab3caab of volume be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e8f036-704e-44de-9cef-ed39f5fd8527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a1f564-c7b6-4985-9875-49c584729fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1fda86-3507-4311-a1cf-cbcbb41b0bd2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:51 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Volume volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc (927257c0-ba2b-480b-8711-0eb7bb9e7cbc): created successfully Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a1f564-c7b6-4985-9875-49c584729fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:51 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Flow 'volume_create_manager' (f5ae495d-72ac-461c-89ae-c4672e772282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1b998e3a-e6aa-4bbd-8300-854565d24f08" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-quobyte-1b998e3a-e6aa-4bbd-8300-854565d24f08" released by "delete_volume" :: held 1.729s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b3c69ccf-3bf4-4a60-a9e7-dadcdd3cc4dc tempest-SnapshotDependencyTests-115715517 None] Created volume successfully. Jul 08 03:50:51 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 Jul 08 03:50:51 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Created reservations ['738e6400-f035-4d0a-8562-c6d10af253aa', '85a417b1-1b2b-4455-b90d-55db8263ead2', '317a1a4c-d6fa-405f-a12e-3bf2f6617095', '2b34be75-1822-4b44-b3fe-bc46895c42d3'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:51 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:51 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:51 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be7650b7-8c8f-4dc2-963f-de8a8a7b8702" returned: 0 in 0.735s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-be7650b7-8c8f-4dc2-963f-de8a8a7b8702" released by "delete_volume" :: held 1.649s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created reservations ['f922d011-a123-4e75-888e-e14cb023762d', '1aee0bfe-39b8-45f4-89c4-ada6aa60a006', '59138e8d-1bd3-4c0d-a4bc-0e79b40c2c65', 'c30f38bb-448b-4646-a4ec-f87e7879e772'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:51 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:51 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:52 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0" returned: 0 in 1.051s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:52 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-a51b16ec-9b8b-4a9d-a822-25966b6734f1-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:52 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab 1G Jul 08 03:50:52 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.927s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-a51b16ec-9b8b-4a9d-a822-25966b6734f1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Deleted volume successfully. Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-4c7157cc-b7d4-435f-a125-17c93f365b1f tempest-CreateVolumesFromSnapshotTest-945095075 None] Lock "cinder-1b998e3a-e6aa-4bbd-8300-854565d24f08-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-quobyte-a51b16ec-9b8b-4a9d-a822-25966b6734f1" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-a51b16ec-9b8b-4a9d-a822-25966b6734f1" acquired by "delete_volume" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578ab9e-899a-475b-a514-1741fa7e86e8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:52 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.912s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Deleted volume successfully. Jul 08 03:50:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fd0c42e1-a241-4968-a266-088e9f4cb334 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-be7650b7-8c8f-4dc2-963f-de8a8a7b8702-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:52 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 Jul 08 03:50:52 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:53 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab 1G" returned: 0 in 1.088s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:53 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab Jul 08 03:50:53 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:53 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1" returned: 0 in 0.908s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:53 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1 Jul 08 03:50:53 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:53 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-a51b16ec-9b8b-4a9d-a822-25966b6734f1" returned: 0 in 0.678s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-a51b16ec-9b8b-4a9d-a822-25966b6734f1" released by "delete_volume" :: held 1.645s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:53 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab" returned: 0 in 0.790s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:53 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab is being set with open permissions: ugo+rw Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:53 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab Jul 08 03:50:53 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:53 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created reservations ['f0dd9d32-8951-42ea-bf3f-d751ff004bd7', '3a9087ba-37d5-4cbf-96e1-8f4f3f83c177', '478aa9e9-749f-4c33-b734-e91f3a10dc65', 'dcff3e4e-e197-4a0c-b22d-1a7854df944f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:54 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:54 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-5e266999-c456-49dd-b810-f6d5d6910c08-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-5e266999-c456-49dd-b810-f6d5d6910c08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-quobyte-5e266999-c456-49dd-b810-f6d5d6910c08" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-5e266999-c456-49dd-b810-f6d5d6910c08" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[801fd92b-e83f-4472-a374-5866e7344f61]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:54 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 Jul 08 03:50:54 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:54 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab" returned: 0 in 0.719s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:54 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info Jul 08 03:50:54 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:54 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.797s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Deleted volume successfully. Jul 08 03:50:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-bac30968-1929-46b2-b74b-b4419b090068 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-a51b16ec-9b8b-4a9d-a822-25966b6734f1-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:55 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08" returned: 0 in 0.782s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:55 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08 Jul 08 03:50:55 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:55 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info" returned: 0 in 0.715s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:55 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info is being set with open permissions: ugo+rw Jul 08 03:50:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:55 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info Jul 08 03:50:55 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:55 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5e266999-c456-49dd-b810-f6d5d6910c08" returned: 0 in 0.690s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-5e266999-c456-49dd-b810-f6d5d6910c08" released by "delete_volume" :: held 1.531s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created reservations ['3182cae1-922b-4b07-bb3d-3bc92fa503d2', '9f63a997-92cc-4c31-be09-ea7ea096e15d', 'd9e8cfd4-d1b3-4876-823e-2897265fc5fd', '38d2b53b-f792-4a43-b003-65e6c3bbbca0'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:56 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.info" returned: 0 in 0.667s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.126s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.076s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Creating offline snapshot c164bc54-7081-4740-a776-e022577ae02c of volume 927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:50:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-98230918-4ae2-43e3-913e-4772d81a7979 tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfae1aa-3c93-4661-8a0f-bfad641ead88]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:56 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:56 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:56 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:50:56 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-05a80a08-9378-4237-96fb-ca10c136029a-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-05a80a08-9378-4237-96fb-ca10c136029a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-quobyte-05a80a08-9378-4237-96fb-ca10c136029a" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-05a80a08-9378-4237-96fb-ca10c136029a" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf08da-12ec-43ff-acb8-9bab3fa547ba]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:56 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.678s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Deleted volume successfully. Jul 08 03:50:56 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a Jul 08 03:50:56 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-83d6e8d3-3e48-4fab-9df3-1f0fe3733823 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-5e266999-c456-49dd-b810-f6d5d6910c08-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-ecf0b2ab-d06d-49e0-9937-bc742ab3caab-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-ecf0b2ab-d06d-49e0-9937-bc742ab3caab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-be9ead31-ce46-42ae-8b58-29da1bb146f0" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:57 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.911s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-be9ead31-ce46-42ae-8b58-29da1bb146f0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-ecf0b2ab-d06d-49e0-9937-bc742ab3caab" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-ecf0b2ab-d06d-49e0-9937-bc742ab3caab" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:57 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c 1G Jul 08 03:50:57 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot ecf0b2ab-d06d-49e0-9937-bc742ab3caab of volume be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6d9d4d-b939-42b0-a829-35df632027a8]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:57 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab Jul 08 03:50:57 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:57 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a" returned: 0 in 0.888s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:57 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a Jul 08 03:50:57 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:50:58 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Flow 'volume_create_manager' (8d471c00-196f-4ea8-a743-f2c7a79499bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c9fdd-eea8-44d8-916e-7395fd12a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab" returned: 0 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be9ead31-ce46-42ae-8b58-29da1bb146f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:50:58 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c 1G" returned: 0 in 1.013s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69bb273-911d-4d22-8397-317ee54bc6eb]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:58 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c Jul 08 03:50:58 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c9fdd-eea8-44d8-916e-7395fd12a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f167eb-0259-438b-b3e1-b00786774d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bafbd2a3b76b44a984e1d5e1a6a18f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:58Z,use_quota=True,user_id='2751e8d4c4de425c9c330f97c7c66c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e539644a-a1eb-45da-9310-38ea90412ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e539644a-a1eb-45da-9310-38ea90412ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e445e3c-6d08-4050-aa5b-7170ecf7f69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.image.glance [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Creating Keystone auth plugin from conf {{(pid=86294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 03:50:58 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 Jul 08 03:50:58 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e445e3c-6d08-4050-aa5b-7170ecf7f69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0f167eb-0259-438b-b3e1-b00786774d3c', 'volume_name': 'volume-d0f167eb-0259-438b-b3e1-b00786774d3c', 'volume_size': 1, 'image_id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0fa639-ab8d-488e-a509-4b89694b99f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77bc9a3598cbf44e420c7b319ecc57a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bafbd2a3b76b44a984e1d5e1a6a18f2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ec4d4f916e96fc83e16e33ea50fe7a94386404a303f4bb75594d5a96adac91fd6a419673ba455efcb813daef6037991ea923f2c5dc3f6246517247d605bf12b', 'id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'created_at': datetime.datetime(2026, 7, 8, 1, 50, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0fa639-ab8d-488e-a509-4b89694b99f6/file', 'properties': {}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0561a1d-1e39-4da0-a191-aa3816d7f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0561a1d-1e39-4da0-a191-aa3816d7f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31660e3-48ef-4f1b-82b3-7614ce749181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:50:58 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Volume d0f167eb-0259-438b-b3e1-b00786774d3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0f167eb-0259-438b-b3e1-b00786774d3c', 'volume_size': 1, 'image_id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0fa639-ab8d-488e-a509-4b89694b99f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77bc9a3598cbf44e420c7b319ecc57a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bafbd2a3b76b44a984e1d5e1a6a18f2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ec4d4f916e96fc83e16e33ea50fe7a94386404a303f4bb75594d5a96adac91fd6a419673ba455efcb813daef6037991ea923f2c5dc3f6246517247d605bf12b', 'id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'created_at': datetime.datetime(2026, 7, 8, 1, 50, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0fa639-ab8d-488e-a509-4b89694b99f6/file', 'properties': {}}, 'image_service': } Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Trying to clone d0f167eb-0259-438b-b3e1-b00786774d3c from image cd0fa639-ab8d-488e-a509-4b89694b99f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0fa639-ab8d-488e-a509-4b89694b99f6', 'metadata': {}}]). {{(pid=86294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 03:50:58 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05a80a08-9378-4237-96fb-ca10c136029a" returned: 0 in 0.814s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-05a80a08-9378-4237-96fb-ca10c136029a" released by "delete_volume" :: held 1.758s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 03:50:58 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Image download 0.00 MB at 0.00 MB/s Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created reservations ['a12024df-dc84-40fd-b37a-ed22623a6f83', 'a40ed913-96dd-4283-86ad-8ba8a454e77e', '24afd5c9-dc84-470b-a48c-b5569e53a9bd', 'e4ba577e-7c27-449a-a31f-f5d93c20ba1a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54f2c2-4652-4e93-a0e8-4f0fddcb697c]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:58 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:50:58 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:58 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD Jul 08 03:50:58 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:58 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c" returned: 0 in 0.823s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:58 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c is being set with open permissions: ugo+rw Jul 08 03:50:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:58 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c Jul 08 03:50:58 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-6cdd3e5d-b478-496c-be34-d6e5b05b148e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:59 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0" returned: 0 in 0.937s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:59 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab Jul 08 03:50:59 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-6cdd3e5d-b478-496c-be34-d6e5b05b148e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "cinder-quobyte-6cdd3e5d-b478-496c-be34-d6e5b05b148e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-6cdd3e5d-b478-496c-be34-d6e5b05b148e" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a0f2a-3035-4b6f-8330-0baa15603741]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:59 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e Jul 08 03:50:59 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:59 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:50:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Deleted volume successfully. Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-03d5fb5f-ce5b-470c-ab5d-479426be20d6 tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-05a80a08-9378-4237-96fb-ca10c136029a-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:50:59 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:59 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD Jul 08 03:50:59 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:50:59 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c" returned: 0 in 0.912s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:50:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:50:59 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info Jul 08 03:50:59 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:00 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab" returned: 0 in 0.986s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:00 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab Jul 08 03:51:00 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:00 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e" returned: 0 in 1.011s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:00 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e Jul 08 03:51:00 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:00 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD" returned: 1 in 0.766s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Temporary image cd0fa639-ab8d-488e-a509-4b89694b99f6 is fetched for user 2751e8d4c4de425c9c330f97c7c66c4d. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9110706-ea50-472d-8cdf-1caec4b5773b]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:00 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD Jul 08 03:51:00 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:00 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info" returned: 0 in 0.819s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:00 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info is being set with open permissions: ugo+rw Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:00 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info Jul 08 03:51:00 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:00 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0.ecf0b2ab-d06d-49e0-9937-bc742ab3caab" returned: 0 in 0.752s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-ecf0b2ab-d06d-49e0-9937-bc742ab3caab" released by "_delete_snapshot" :: held 3.715s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-be9ead31-ce46-42ae-8b58-29da1bb146f0" released by "delete_snapshot" :: held 3.748s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Created reservations ['5f07bb24-be3f-48fd-ae8b-2679cd80ddb4', '33f6120e-1e46-4a6c-9bdd-9d03b10ee7d6', '91505d55-21b5-438f-884f-2a43830fff17', 'b701d83c-9904-4490-a884-c7d545da02fa'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:00 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-6cdd3e5d-b478-496c-be34-d6e5b05b148e" returned: 0 in 0.697s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-quobyte-6cdd3e5d-b478-496c-be34-d6e5b05b148e" released by "delete_volume" :: held 1.763s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:00 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b658ca0b-b679-406c-97b5-840fca5d13f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-ecf0b2ab-d06d-49e0-9937-bc742ab3caab-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:00 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Created reservations ['625478c2-2b96-45c7-aa09-f2762fcc6c03', '364ad10f-63b9-4079-8051-bbe8ddd3023c', 'd49bea52-a535-4f54-9ffa-81ea81cc1ef6', '5610f3af-32a5-45a4-9b3f-361f4bbadb2a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:01 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:01 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:01 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-be9ead31-ce46-42ae-8b58-29da1bb146f0-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:01 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD Jul 08 03:51:01 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-be9ead31-ce46-42ae-8b58-29da1bb146f0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:01 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.info" returned: 0 in 0.760s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.367s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1deb1b7b-f7d0-4239-864e-6075bf66ce76 tempest-SnapshotDependencyTests-115715517 None] Create snapshot completed successfully Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-be9ead31-ce46-42ae-8b58-29da1bb146f0" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-be9ead31-ce46-42ae-8b58-29da1bb146f0" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a114d435-3ecd-419c-a81d-5700360dbf85]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:01 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 Jul 08 03:51:01 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:01 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.831s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Deleted volume successfully. Jul 08 03:51:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a236dffa-82ea-432f-bc72-428f66010d0e tempest-CreateVolumesFromSourceVolumeTest-2147039763 None] Lock "cinder-6cdd3e5d-b478-496c-be34-d6e5b05b148e-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:02 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD" returned: 1 in 0.886s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f167eb-0259-438b-b3e1-b00786774d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bafbd2a3b76b44a984e1d5e1a6a18f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:50:58Z,use_quota=True,user_id='2751e8d4c4de425c9c330f97c7c66c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Creating volume d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:02 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:02 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c 1073741824 Jul 08 03:51:02 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:02 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0" returned: 0 in 0.873s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:02 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0 Jul 08 03:51:02 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:03 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-be9ead31-ce46-42ae-8b58-29da1bb146f0" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:03 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c 1073741824" returned: 0 in 1.152s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-be9ead31-ce46-42ae-8b58-29da1bb146f0" released by "delete_volume" :: held 1.718s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:03 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:03 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Flow 'volume_create_manager' (add468b1-ea3f-4985-a75b-fb45b55c6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54c4078-7302-4de8-a0ef-22ee9e95ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54c4078-7302-4de8-a0ef-22ee9e95ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5523390b-710b-4b1a-8de7-f067d554deff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0af1b556ea54b3086b5253e76b44dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c164bc54-7081-4740-a776-e022577ae02c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:03Z,use_quota=True,user_id='305a3a9cb26649fb979efd26b345b30e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974bfc5c-84a2-4943-a76d-1c7aeea0dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974bfc5c-84a2-4943-a76d-1c7aeea0dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6132415-f82c-43b5-840d-31342c08223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6132415-f82c-43b5-840d-31342c08223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5523390b-710b-4b1a-8de7-f067d554deff', 'volume_name': 'volume-5523390b-710b-4b1a-8de7-f067d554deff', 'volume_size': 1, 'snapshot_id': 'c164bc54-7081-4740-a776-e022577ae02c'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e6e0f2-007c-4c14-bb76-bb5ab40b9438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e6e0f2-007c-4c14-bb76-bb5ab40b9438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c31bec-219c-4ddd-89a6-f3e755c110e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:03 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Volume 5523390b-710b-4b1a-8de7-f067d554deff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5523390b-710b-4b1a-8de7-f067d554deff', 'volume_size': 1, 'snapshot_id': 'c164bc54-7081-4740-a776-e022577ae02c'} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Created reservations ['23f7c651-8a23-4faa-8e7a-0aa007da6fd2', '13c4c8c4-daa2-4f82-81da-c197181ed258', 'ee373e11-2f3d-44d9-b740-34dc7469b772', '00b70a80-b29f-473b-99bd-298b610ba6a9'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:03 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:03 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:04 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 0 in 0.791s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.686s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-quobyte-c164bc54-7081-4740-a776-e022577ae02c-5523390b-710b-4b1a-8de7-f067d554deff" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-c164bc54-7081-4740-a776-e022577ae02c-5523390b-710b-4b1a-8de7-f067d554deff" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Creating volume 5523390b-710b-4b1a-8de7-f067d554deff from snapshot c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-quobyte-5523390b-710b-4b1a-8de7-f067d554deff" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Attempting download of cd0fa639-ab8d-488e-a509-4b89694b99f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0fa639-ab8d-488e-a509-4b89694b99f6', 'metadata': {}}])) to volume d0f167eb-0259-438b-b3e1-b00786774d3c. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (c77324b3-b743-4fa8-99ae-eced11b893d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3c2cf9-8dff-45ad-a3b4-9cd7ea93e60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-5523390b-710b-4b1a-8de7-f067d554deff" acquired by "_copy_volume_from_snapshot" :: waited 0.129s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] snapshot: c164bc54-7081-4740-a776-e022577ae02c, volume: 5523390b-710b-4b1a-8de7-f067d554deff, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05d6da-21ab-472f-9c1a-f9539037da97]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:04 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3c2cf9-8dff-45ad-a3b4-9cd7ea93e60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728544404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acc224a-6051-4857-9fbe-b2c2722f151a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:04Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a5bd6c-8482-43ce-a02b-20c515a63f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a5bd6c-8482-43ce-a02b-20c515a63f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caac04f5-9ff0-4f0e-8d01-a0840dd67524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caac04f5-9ff0-4f0e-8d01-a0840dd67524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acc224a-6051-4857-9fbe-b2c2722f151a', 'volume_name': 'volume-9acc224a-6051-4857-9fbe-b2c2722f151a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427ae62c-f305-4987-8e4f-f0293134d372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427ae62c-f305-4987-8e4f-f0293134d372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa744fbf-a88f-4fe5-a26d-eba5e3f6af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Volume 9acc224a-6051-4857-9fbe-b2c2722f151a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acc224a-6051-4857-9fbe-b2c2722f151a', 'volume_size': 1} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.927s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b43dd87-2151-490e-9f4a-9d3d16a8d7c3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:04 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49 Jul 08 03:51:04 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ab19997c-ecd7-4c2b-a920-60fe1d4254f4 tempest-ProjectMemberTests-45241866 None] Lock "cinder-be9ead31-ce46-42ae-8b58-29da1bb146f0-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:04 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c Jul 08 03:51:04 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Flow 'volume_create_manager' (4245bdd9-f46d-4fbb-b349-23899d7c2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13548651-61b6-472e-b20b-1d5d1798a643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13548651-61b6-472e-b20b-1d5d1798a643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1102568644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94268700-0e0a-43ca-bd4c-3109ab5c26a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d464a27290c84df79890c3f5c4e218e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:05Z,use_quota=True,user_id='ff9cbf7179da490e8a153e7207bb9630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2817b2bd-6a88-4df9-9f40-f17b6ff51161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2817b2bd-6a88-4df9-9f40-f17b6ff51161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d1d128-94e5-406a-92b5-24441d5e92ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d1d128-94e5-406a-92b5-24441d5e92ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94268700-0e0a-43ca-bd4c-3109ab5c26a2', 'volume_name': 'volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c6d4bb-9a5a-48a2-8ce1-eb0542875ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c6d4bb-9a5a-48a2-8ce1-eb0542875ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528380d8-a319-4350-8365-d9a986717960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:04 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Volume 94268700-0e0a-43ca-bd4c-3109ab5c26a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2', 'volume_size': 1} Jul 08 03:51:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:05 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49" returned: 0 in 0.812s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:05 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c" returned: 0 in 0.807s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:51:05 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49 Jul 08 03:51:05 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[418bd3d1-aaa0-4ce3-88ff-e28b2776fd08]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:05 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:51:05 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:05 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49" returned: 1 in 0.763s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0fa639-ab8d-488e-a509-4b89694b99f6_6rdqmj49' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcf29e6-3ab9-4975-a3c9-5452604c202a]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:06 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD Jul 08 03:51:06 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:06 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:06 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:51:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:06 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff Jul 08 03:51:06 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:06 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:06 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD Jul 08 03:51:06 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:08 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD" returned: 1 in 1.316s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:51:08 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] cd0fa639-ab8d-488e-a509-4b89694b99f6 was raw, converting to raw {{(pid=86294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 03:51:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:08 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:08 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:10 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 0 in 2.190s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:10 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0fa639-ab8d-488e-a509-4b89694b99f6_0_ntqr6zdevstack@QuobyteHD, size 0.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:51:10 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 03:51:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:10 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c 1G Jul 08 03:51:10 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:11 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff" returned: 0 in 5.256s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f80a72-e356-43e3-9949-a54cf9284478]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:11 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c 1G" returned: 0 in 1.220s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:11 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:51:11 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2e33f-e82c-49a0-a462-3b403a7ff858]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:11 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:11 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:12 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 0 in 0.746s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:12 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.955s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:51:12 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Converted 1024.00 MB image at 194.75 MB/s Jul 08 03:51:12 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff is being set with open permissions: ugo+rw Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:12 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:12 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:12 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff Jul 08 03:51:12 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:12 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff" returned: 0 in 0.643s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:12 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-5523390b-710b-4b1a-8de7-f067d554deff" released by "_copy_volume_from_snapshot" :: held 8.641s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 1 in 0.748s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Downloaded image cd0fa639-ab8d-488e-a509-4b89694b99f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0fa639-ab8d-488e-a509-4b89694b99f6', 'metadata': {}}])) to volume d0f167eb-0259-438b-b3e1-b00786774d3c successfully. {{(pid=86294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Temporary image cd0fa639-ab8d-488e-a509-4b89694b99f6 for user 2751e8d4c4de425c9c330f97c7c66c4d is deleted. {{(pid=86294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.volume.volume_utils [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Marking volume d0f167eb-0259-438b-b3e1-b00786774d3c as bootable. {{(pid=86294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-c164bc54-7081-4740-a776-e022577ae02c-5523390b-710b-4b1a-8de7-f067d554deff" released by "_create_volume_from_snapshot" :: held 8.795s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.850s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.556s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728544404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acc224a-6051-4857-9fbe-b2c2722f151a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:04Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Creating volume 9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:13 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:13 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a 1073741824 Jul 08 03:51:13 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Copying metadata from image cd0fa639-ab8d-488e-a509-4b89694b99f6 to d0f167eb-0259-438b-b3e1-b00786774d3c. {{(pid=86294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Creating volume glance metadata for volume d0f167eb-0259-438b-b3e1-b00786774d3c backed by image cd0fa639-ab8d-488e-a509-4b89694b99f6 with: {'image_id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '77bc9a3598cbf44e420c7b319ecc57a6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c31bec-219c-4ddd-89a6-f3e755c110e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5523390b-710b-4b1a-8de7-f067d554deff', 'volume_size': 1, 'snapshot_id': 'c164bc54-7081-4740-a776-e022577ae02c'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60f960f-be67-4cdc-aab9-3c97591e2193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:13 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Volume volume-5523390b-710b-4b1a-8de7-f067d554deff (5523390b-710b-4b1a-8de7-f067d554deff): created successfully Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60f960f-be67-4cdc-aab9-3c97591e2193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Flow 'volume_create_manager' (add468b1-ea3f-4985-a75b-fb45b55c6042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a8eef7aa-7f1e-45d4-b0e1-f2ff9330935f tempest-SnapshotDependencyTests-115715517 None] Created volume successfully. Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31660e3-48ef-4f1b-82b3-7614ce749181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f167eb-0259-438b-b3e1-b00786774d3c', 'volume_size': 1, 'image_id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0fa639-ab8d-488e-a509-4b89694b99f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '77bc9a3598cbf44e420c7b319ecc57a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bafbd2a3b76b44a984e1d5e1a6a18f2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ec4d4f916e96fc83e16e33ea50fe7a94386404a303f4bb75594d5a96adac91fd6a419673ba455efcb813daef6037991ea923f2c5dc3f6246517247d605bf12b', 'id': 'cd0fa639-ab8d-488e-a509-4b89694b99f6', 'created_at': datetime.datetime(2026, 7, 8, 1, 50, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 1, 50, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0fa639-ab8d-488e-a509-4b89694b99f6/file', 'properties': {}}, 'image_service': }' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52559d94-2bbb-4b31-b721-ddbadb078647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:13 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Volume volume-d0f167eb-0259-438b-b3e1-b00786774d3c (d0f167eb-0259-438b-b3e1-b00786774d3c): created successfully Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52559d94-2bbb-4b31-b721-ddbadb078647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Flow 'volume_create_manager' (8d471c00-196f-4ea8-a743-f2c7a79499bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:13 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7a2bb66c-0175-4e53-9246-3be44eef6631 tempest-VolumeImageDependencyTests-1593254055 None] Created volume successfully. Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Acquiring lock "cinder-d0f167eb-0259-438b-b3e1-b00786774d3c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Lock "cinder-d0f167eb-0259-438b-b3e1-b00786774d3c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Acquiring lock "cinder-quobyte-d0f167eb-0259-438b-b3e1-b00786774d3c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Lock "cinder-quobyte-d0f167eb-0259-438b-b3e1-b00786774d3c" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1beafbc-9273-4cb3-82e1-cce98e0c3177]: (4, 'raw') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:13 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:13 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:13 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a 1073741824" returned: 0 in 0.840s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:13 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a Jul 08 03:51:13 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-c164bc54-7081-4740-a776-e022577ae02c-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-c164bc54-7081-4740-a776-e022577ae02c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-quobyte-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-quobyte-c164bc54-7081-4740-a776-e022577ae02c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-c164bc54-7081-4740-a776-e022577ae02c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Deleting offline snapshot c164bc54-7081-4740-a776-e022577ae02c of volume 927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:51:14 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] snapshot_file for this snap is: volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a5dba-0e4a-4a4d-a825-55772f114239]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:14 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:14 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:14 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c Jul 08 03:51:14 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:14 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.726s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1102568644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94268700-0e0a-43ca-bd4c-3109ab5c26a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d464a27290c84df79890c3f5c4e218e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:05Z,use_quota=True,user_id='ff9cbf7179da490e8a153e7207bb9630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Creating volume 94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:14 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:14 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 1073741824 Jul 08 03:51:14 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa744fbf-a88f-4fe5-a26d-eba5e3f6af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acc224a-6051-4857-9fbe-b2c2722f151a', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fab4a09-43de-436e-a581-8677ef02a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:14 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Volume volume-9acc224a-6051-4857-9fbe-b2c2722f151a (9acc224a-6051-4857-9fbe-b2c2722f151a): created successfully Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fab4a09-43de-436e-a581-8677ef02a15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:14 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (c77324b3-b743-4fa8-99ae-eced11b893d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:14 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-c1d84595-3815-4d2d-b63a-4fd5df075b01 tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:51:15 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 1 in 0.809s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c' failed. Not Retrying. {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:15 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c" returned: 0 in 0.834s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:15 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c Jul 08 03:51:15 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eda2be-ba85-46da-b5d4-6578429c8aca]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:15 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:51:15 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:15 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 1073741824" returned: 0 in 0.939s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:15 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:15 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:15 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d0f167eb-0259-438b-b3e1-b00786774d3c" returned: 0 in 0.734s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:15 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Lock "cinder-quobyte-d0f167eb-0259-438b-b3e1-b00786774d3c" released by "delete_volume" :: held 2.391s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Created reservations ['f6083781-e5b0-45ad-b601-7372ffd435eb', 'c22e14e3-611b-4925-a909-03009ab7baff', 'db01f22e-17c8-4c1f-8fe9-15792bd3daef', '096ee514-8bfd-48c5-84e3-831d8649f521'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:16 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.834s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:16 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:16 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:16 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c Jul 08 03:51:16 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:16 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.664s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.892s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528380d8-a319-4350-8365-d9a986717960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff80a11-3b3a-410b-ad99-151ede4495b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Creating offline snapshot 90da4321-0a5b-480f-aba8-0047b4171d14 of volume 9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:51:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Volume volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 (94268700-0e0a-43ca-bd4c-3109ab5c26a2): created successfully Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff80a11-3b3a-410b-ad99-151ede4495b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Flow 'volume_create_manager' (4245bdd9-f46d-4fbb-b349-23899d7c2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df4426-27a0-4b5f-8029-a953f3c17278]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fd0d6330-c475-4223-a49e-2675cd451080 tempest-VolumeDependencyTests-1029283513 None] Created volume successfully. Jul 08 03:51:16 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a Jul 08 03:51:16 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:16 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.719s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Deleted volume successfully. Jul 08 03:51:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a8ab3da0-1379-4a8f-a89b-771e026e892f tempest-VolumeImageDependencyTests-1593254055 None] Lock "cinder-d0f167eb-0259-438b-b3e1-b00786774d3c-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:17 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c" returned: 0 in 0.909s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:17 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c Jul 08 03:51:17 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:17 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a" returned: 0 in 0.900s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:17 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 1G Jul 08 03:51:17 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:17 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc.c164bc54-7081-4740-a776-e022577ae02c" returned: 0 in 0.674s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-c164bc54-7081-4740-a776-e022577ae02c" released by "_delete_snapshot" :: held 3.377s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" released by "delete_snapshot" :: held 3.402s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Created reservations ['81078b5d-8290-46b4-a296-5157084b217a', '228503e7-6531-41b1-bab8-abb1d08f0495', 'a74388ea-633e-42a2-94e4-a16d163ab52c', '836e95b9-0a71-4edc-880a-f213aa1bab3a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Delete snapshot completed successfully. Jul 08 03:51:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e4549016-eff7-4c86-b85a-cbea8ad6526e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-c164bc54-7081-4740-a776-e022577ae02c-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:18 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 1G" returned: 0 in 0.919s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acc224a-6051-4857-9fbe-b2c2722f151a -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:18 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acc224a-6051-4857-9fbe-b2c2722f151a -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 Jul 08 03:51:18 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-927257c0-ba2b-480b-8711-0eb7bb9e7cbc-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-927257c0-ba2b-480b-8711-0eb7bb9e7cbc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-quobyte-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26ae0a-2bff-4832-a345-37b41907c5d2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9acc224a-6051-4857-9fbe-b2c2722f151a -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14" returned: 0 in 0.717s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:18 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 is being set with open permissions: ugo+rw Jul 08 03:51:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:18 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:18 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:51:18 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:18 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 Jul 08 03:51:18 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:19 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.802s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:19 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:19 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc Jul 08 03:51:19 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:19 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info Jul 08 03:51:19 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Flow 'volume_create_manager' (86ce5cb0-a499-44e8-9d25-323c18066a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a933c763-961b-4ea8-bca5-0604bffc8d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:20 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" returned: 0 in 0.704s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a933c763-961b-4ea8-bca5-0604bffc8d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f307f8bf-23dd-4c62-b0b9-96c774e7cc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582f978a460f4bbaad98a411b1a8240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:20Z,use_quota=True,user_id='54c362d5206946d490d7762cbab57e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256bff89-bb04-444d-b25b-3801b75c4e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256bff89-bb04-444d-b25b-3801b75c4e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d2ab68-1988-47b4-a2a6-c760af9818d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d2ab68-1988-47b4-a2a6-c760af9818d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f307f8bf-23dd-4c62-b0b9-96c774e7cc79', 'volume_name': 'volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9e369e-ad56-40e4-b573-88604fd639fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9e369e-ad56-40e4-b573-88604fd639fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58744098-17e4-472f-985c-10de6a64722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Volume f307f8bf-23dd-4c62-b0b9-96c774e7cc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79', 'volume_size': 1} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-927257c0-ba2b-480b-8711-0eb7bb9e7cbc" released by "delete_volume" :: held 1.611s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:20 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info" returned: 0 in 0.738s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:20 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info is being set with open permissions: ugo+rw Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:20 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info Jul 08 03:51:20 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Created reservations ['c05c691f-8baa-4b87-9fae-38dd4b6e5ead', '25bca946-a496-49a3-90c6-0df567f68cdf', '060ae5c6-747f-4ab8-aa32-b191c1854f83', 'e1602bc5-db7b-4441-9bb3-abc6a724285e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:20 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:20 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-5523390b-710b-4b1a-8de7-f067d554deff-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-5523390b-710b-4b1a-8de7-f067d554deff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "cinder-quobyte-5523390b-710b-4b1a-8de7-f067d554deff" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-5523390b-710b-4b1a-8de7-f067d554deff" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[978ab7ea-2618-4dc4-8b3d-c5f1730d6410]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:21 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.info" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.812s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.045s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Creating offline snapshot 18132372-8438-4ed4-ad08-d325fc68fe82 of volume 94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:51:21 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff Jul 08 03:51:21 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-635b3fef-5d54-4428-a5f5-0bde58a9265e tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2532e67a-0136-4b70-923e-08c76abf6510]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:21 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.702s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Deleted volume successfully. Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-afd2645a-829d-4da9-ae74-b08c668354bd tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-927257c0-ba2b-480b-8711-0eb7bb9e7cbc-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:21 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:21 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-90da4321-0a5b-480f-aba8-0047b4171d14-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-90da4321-0a5b-480f-aba8-0047b4171d14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-9acc224a-6051-4857-9fbe-b2c2722f151a" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-9acc224a-6051-4857-9fbe-b2c2722f151a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-90da4321-0a5b-480f-aba8-0047b4171d14" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-90da4321-0a5b-480f-aba8-0047b4171d14" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot 90da4321-0a5b-480f-aba8-0047b4171d14 of volume 9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0c1526-d4ab-494a-a02c-44b300d42a8e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:21 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff" returned: 0 in 0.830s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:21 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 Jul 08 03:51:21 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:21 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff Jul 08 03:51:21 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:21 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.809s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:21 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 1G Jul 08 03:51:21 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:22 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9acc224a-6051-4857-9fbe-b2c2722f151a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[deed67f5-6afd-448d-8b8f-3a8fca3c124c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:22 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5523390b-710b-4b1a-8de7-f067d554deff" returned: 0 in 0.719s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-quobyte-5523390b-710b-4b1a-8de7-f067d554deff" released by "delete_volume" :: held 1.599s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Created reservations ['f19c0166-87fc-4c80-899e-1a20909b00d1', 'd7611c93-0a81-4464-994f-63ba99f8ef3a', '08cdda39-ccff-43fd-8cde-9faec0224763', '93f9a3ef-be9b-4687-825f-41b6b4fb1bc2'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:22 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a Jul 08 03:51:22 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:22 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:22 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:22 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 1G" returned: 0 in 0.832s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:22 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 Jul 08 03:51:22 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:23 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a" returned: 0 in 0.842s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:23 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.722s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:23 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 Jul 08 03:51:23 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:23 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Deleted volume successfully. Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5f5f90dd-750b-403a-b1ec-9f1c2f139f5e tempest-SnapshotDependencyTests-115715517 None] Lock "cinder-5523390b-710b-4b1a-8de7-f067d554deff-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:23 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82" returned: 0 in 0.802s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:23 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 is being set with open permissions: ugo+rw Jul 08 03:51:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:23 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 Jul 08 03:51:23 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:24 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14" returned: 0 in 0.821s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:24 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14 Jul 08 03:51:24 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:24 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:24 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info Jul 08 03:51:24 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:24 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a.90da4321-0a5b-480f-aba8-0047b4171d14" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-90da4321-0a5b-480f-aba8-0047b4171d14" released by "_delete_snapshot" :: held 3.257s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-9acc224a-6051-4857-9fbe-b2c2722f151a" released by "delete_snapshot" :: held 3.281s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:24 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Created reservations ['c88706c1-7982-49e9-a3ff-b0162bac947f', 'd7914ae1-7944-4eec-878b-6154a3c11fbe', '5b6a913c-b6b3-46b8-8e47-24a2928f1519', 'bf08500a-b64c-4e2a-8fae-bc8509267de5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:25 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info" returned: 0 in 0.715s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:25 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info is being set with open permissions: ugo+rw Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:25 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info Jul 08 03:51:25 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0b008a01-dd92-43a0-85b8-a64222e57f94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-90da4321-0a5b-480f-aba8-0047b4171d14-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:25 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.info" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.661s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.416s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f307f8bf-23dd-4c62-b0b9-96c774e7cc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582f978a460f4bbaad98a411b1a8240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:20Z,use_quota=True,user_id='54c362d5206946d490d7762cbab57e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Creating volume f307f8bf-23dd-4c62-b0b9-96c774e7cc79 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:25 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:25 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 1073741824 Jul 08 03:51:25 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:25 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-226e945c-e70f-4f4a-bde9-c5d72e13359b tempest-VolumeDependencyTests-1029283513 None] Create snapshot completed successfully Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-9acc224a-6051-4857-9fbe-b2c2722f151a-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:25 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Lock "cinder-9acc224a-6051-4857-9fbe-b2c2722f151a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-9acc224a-6051-4857-9fbe-b2c2722f151a" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-9acc224a-6051-4857-9fbe-b2c2722f151a" acquired by "delete_volume" :: waited 0.024s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[406e83e6-7268-4b5e-b7cb-8f55fee9d434]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:26 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a Jul 08 03:51:26 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:26 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 1073741824" returned: 0 in 0.995s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:26 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 Jul 08 03:51:26 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:27 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a" returned: 0 in 0.992s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:27 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a Jul 08 03:51:27 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Flow 'volume_create_manager' (f47f0162-b568-48d4-bd0e-9b55732839ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c10fbf-5048-4217-9758-b99db27e3f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c10fbf-5048-4217-9758-b99db27e3f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1289223765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05840e84-9667-4bd5-98cb-bc5f259ac727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d464a27290c84df79890c3f5c4e218e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18132372-8438-4ed4-ad08-d325fc68fe82,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:27Z,use_quota=True,user_id='ff9cbf7179da490e8a153e7207bb9630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980ad58d-a49e-4128-b86c-e971165a0875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980ad58d-a49e-4128-b86c-e971165a0875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cbed09-7672-4a4e-a08f-03f129066617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cbed09-7672-4a4e-a08f-03f129066617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05840e84-9667-4bd5-98cb-bc5f259ac727', 'volume_name': 'volume-05840e84-9667-4bd5-98cb-bc5f259ac727', 'volume_size': 1, 'snapshot_id': '18132372-8438-4ed4-ad08-d325fc68fe82'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabb4d91-2950-4d51-8ae0-91632cecda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabb4d91-2950-4d51-8ae0-91632cecda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e52256-d599-4724-a1dc-3a4b9b1ce33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Volume 05840e84-9667-4bd5-98cb-bc5f259ac727: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05840e84-9667-4bd5-98cb-bc5f259ac727', 'volume_size': 1, 'snapshot_id': '18132372-8438-4ed4-ad08-d325fc68fe82'} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:27 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79" returned: 0 in 0.819s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.355s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-quobyte-18132372-8438-4ed4-ad08-d325fc68fe82-05840e84-9667-4bd5-98cb-bc5f259ac727" by "_create_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-18132372-8438-4ed4-ad08-d325fc68fe82-05840e84-9667-4bd5-98cb-bc5f259ac727" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Creating volume 05840e84-9667-4bd5-98cb-bc5f259ac727 from snapshot 18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-quobyte-05840e84-9667-4bd5-98cb-bc5f259ac727" by "_copy_volume_from_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58744098-17e4-472f-985c-10de6a64722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5ba3a9-f7c3-42fc-b00a-d5a73938d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-05840e84-9667-4bd5-98cb-bc5f259ac727" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] snapshot: 18132372-8438-4ed4-ad08-d325fc68fe82, volume: 05840e84-9667-4bd5-98cb-bc5f259ac727, {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 03:51:27 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Volume volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 (f307f8bf-23dd-4c62-b0b9-96c774e7cc79): created successfully Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5ba3a9-f7c3-42fc-b00a-d5a73938d952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Flow 'volume_create_manager' (86ce5cb0-a499-44e8-9d25-323c18066a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:27 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fdf04cca-b8cf-4835-8a4b-227bf50dd67e tempest-CinderUnicodeTest-1806456910 None] Created volume successfully. Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcffc14-ec70-4983-86a9-3cfe3afe03a3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:27 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-9acc224a-6051-4857-9fbe-b2c2722f151a" returned: 0 in 0.680s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-9acc224a-6051-4857-9fbe-b2c2722f151a" released by "delete_volume" :: held 1.745s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Created reservations ['71f30ffa-2e6f-4fa3-9635-11ecb266e3c8', '9ba57540-4d6f-433f-8d6f-d9bdd60e2ef2', '2a575b05-885d-4a06-88f9-efc5568df9ce', '568ff5f4-85cd-41c3-ae5d-097e8e7fca85'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:27 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 Jul 08 03:51:27 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:27 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:27 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:28 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.758s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:28 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1512da29-1f94-40e0-a80e-0e7f0179d43d tempest-ProjectMemberTests-45241866 None] Lock "cinder-9acc224a-6051-4857-9fbe-b2c2722f151a-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:28 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82" returned: 0 in 1.006s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Creating direct copy from snapshot {{(pid=86294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07267b4-eb02-40ae-8204-5964859d11cb]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=165,cinder:UPDATE=201,cinder:INSERT=48,cinder:DELETE=15 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (e74e98ce-5eab-447a-9e98-eeaa802f14bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec7036b-876d-4afa-9eea-627c54bd960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec7036b-876d-4afa-9eea-627c54bd960e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606980735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb73c61b-df21-4515-aadb-92fe9781d424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:29Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf9d129-2865-453f-9071-ab74df6d44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf9d129-2865-453f-9071-ab74df6d44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a215f231-0f3a-441b-9d23-41b16855d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a215f231-0f3a-441b-9d23-41b16855d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb73c61b-df21-4515-aadb-92fe9781d424', 'volume_name': 'volume-cb73c61b-df21-4515-aadb-92fe9781d424', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e122aab5-d397-40da-b21a-d1d72eb05ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e122aab5-d397-40da-b21a-d1d72eb05ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d408baf-d3b3-4bff-a303-42c9ac92b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:28 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Volume cb73c61b-df21-4515-aadb-92fe9781d424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb73c61b-df21-4515-aadb-92fe9781d424', 'volume_size': 1} Jul 08 03:51:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:28 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:28 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Flow 'volume_create_manager' (e2ea54c6-1b68-476d-a44d-d7fa3066b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cb8b35-0b8c-43cc-ab84-bb14db29fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cb8b35-0b8c-43cc-ab84-bb14db29fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-484200205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582f978a460f4bbaad98a411b1a8240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:29Z,use_quota=True,user_id='54c362d5206946d490d7762cbab57e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872d04e5-5e4e-46d0-8ab0-5e772cde560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872d04e5-5e4e-46d0-8ab0-5e772cde560f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bad60b8-b8b2-4780-9de6-b621d7813886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bad60b8-b8b2-4780-9de6-b621d7813886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf', 'volume_name': 'volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939269c8-8eae-4524-a3b0-983708a9edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939269c8-8eae-4524-a3b0-983708a9edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2355b3-2cad-4a18-8394-71c03d52a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:29 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Volume 8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf', 'volume_size': 1} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:29 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.871s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG cinder.utils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Path /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 not found in is_blk_device check {{(pid=86294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 03:51:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:29 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 Jul 08 03:51:29 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:34 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727" returned: 0 in 5.286s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:34 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf7ffc-c3d0-46ca-9055-c29b7d764d59]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:35 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:35 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:35 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.977s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:35 devstack cinder-volume[86294]: DEBUG cinder.image.image_utils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Image conversion details: src /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 {{(pid=86294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 03:51:35 devstack cinder-volume[86294]: INFO cinder.image.image_utils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Converted 1024.00 MB image at 193.68 MB/s Jul 08 03:51:35 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 is being set with open permissions: ugo+rw Jul 08 03:51:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:35 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 Jul 08 03:51:35 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:36 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727" returned: 0 in 0.649s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-05840e84-9667-4bd5-98cb-bc5f259ac727" released by "_copy_volume_from_snapshot" :: held 8.920s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-18132372-8438-4ed4-ad08-d325fc68fe82-05840e84-9667-4bd5-98cb-bc5f259ac727" released by "_create_volume_from_snapshot" :: held 8.979s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.686s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606980735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb73c61b-df21-4515-aadb-92fe9781d424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:29Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Creating volume cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:36 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=153,cinder:INSERT=65,cinder:UPDATE=222,cinder:DELETE=20 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:51:36 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 1073741824 Jul 08 03:51:36 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e52256-d599-4724-a1dc-3a4b9b1ce33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05840e84-9667-4bd5-98cb-bc5f259ac727', 'volume_size': 1, 'snapshot_id': '18132372-8438-4ed4-ad08-d325fc68fe82'}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9ad6b7-2c86-4db8-83ff-673ef1342ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:36 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Volume volume-05840e84-9667-4bd5-98cb-bc5f259ac727 (05840e84-9667-4bd5-98cb-bc5f259ac727): created successfully Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9ad6b7-2c86-4db8-83ff-673ef1342ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Flow 'volume_create_manager' (f47f0162-b568-48d4-bd0e-9b55732839ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:36 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ddf27e13-e367-4dc1-9f9a-e3469d6fd70a tempest-VolumeDependencyTests-1029283513 None] Created volume successfully. Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-18132372-8438-4ed4-ad08-d325fc68fe82-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-18132372-8438-4ed4-ad08-d325fc68fe82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-quobyte-94268700-0e0a-43ca-bd4c-3109ab5c26a2" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-94268700-0e0a-43ca-bd4c-3109ab5c26a2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-quobyte-18132372-8438-4ed4-ad08-d325fc68fe82" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-18132372-8438-4ed4-ad08-d325fc68fe82" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Deleting offline snapshot 18132372-8438-4ed4-ad08-d325fc68fe82 of volume 94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] snapshot_file for this snap is: volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5cd4f2-8de0-4883-90ac-360dfe922f57]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:37 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 Jul 08 03:51:37 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:37 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 1073741824" returned: 0 in 0.824s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:37 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 Jul 08 03:51:37 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:37 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82" returned: 0 in 0.800s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:37 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3023b7-6371-473c-b5ec-2ab48a676268]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:37 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:37 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:38 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.593s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-484200205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582f978a460f4bbaad98a411b1a8240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:29Z,use_quota=True,user_id='54c362d5206946d490d7762cbab57e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Creating volume 8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:38 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:38 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf 1073741824 Jul 08 03:51:38 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d408baf-d3b3-4bff-a303-42c9ac92b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb73c61b-df21-4515-aadb-92fe9781d424', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60e50c-13cb-435a-8709-ca5b7bc581d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:38 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Volume volume-cb73c61b-df21-4515-aadb-92fe9781d424 (cb73c61b-df21-4515-aadb-92fe9781d424): created successfully Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60e50c-13cb-435a-8709-ca5b7bc581d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (e74e98ce-5eab-447a-9e98-eeaa802f14bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:38 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d38371b6-3bae-4387-8724-130e94ea3d75 tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:51:38 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:38 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 Jul 08 03:51:38 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:39 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf 1073741824" returned: 0 in 0.896s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:39 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf Jul 08 03:51:39 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:39 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82" returned: 0 in 0.780s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:39 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82 Jul 08 03:51:39 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:39 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" returned: 0 in 0.634s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.833s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2355b3-2cad-4a18-8394-71c03d52a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7a95ad-ee11-466c-8890-b42844facf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Creating offline snapshot e3fe6180-c097-4b6e-b480-f4b8c3761837 of volume cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:51:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Volume volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf (8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf): created successfully Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7a95ad-ee11-466c-8890-b42844facf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Flow 'volume_create_manager' (e2ea54c6-1b68-476d-a44d-d7fa3066b714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f1823-f552-4388-bde2-283eb8b7583c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-404359f3-d627-49ae-8359-19f4d152cdec tempest-CinderUnicodeTest-1806456910 None] Created volume successfully. Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:39 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 Jul 08 03:51:39 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:39 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2.18132372-8438-4ed4-ad08-d325fc68fe82" returned: 0 in 0.654s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-18132372-8438-4ed4-ad08-d325fc68fe82" released by "_delete_snapshot" :: held 3.117s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-94268700-0e0a-43ca-bd4c-3109ab5c26a2" released by "delete_snapshot" :: held 3.141s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Created reservations ['67b6c9a8-0820-4c07-82a7-2bda82b2d714', 'a719ba13-cb50-4e41-93bf-4071a83b8936', '308a7b2e-c5f5-48eb-80ac-4e02aeccbbb9', '9a1bae15-afc4-430a-820a-0d67ce331b5f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Delete snapshot completed successfully. Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f95a28f2-03f5-4ab6-ad9e-e1956543ac8c tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-18132372-8438-4ed4-ad08-d325fc68fe82-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:40 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424" returned: 0 in 0.782s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:40 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 1G Jul 08 03:51:40 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-94268700-0e0a-43ca-bd4c-3109ab5c26a2-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-94268700-0e0a-43ca-bd4c-3109ab5c26a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-quobyte-94268700-0e0a-43ca-bd4c-3109ab5c26a2" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-94268700-0e0a-43ca-bd4c-3109ab5c26a2" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6dedd2-2699-4255-9a47-454f7f67f760]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:41 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:41 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:41 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 1G" returned: 0 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb73c61b-df21-4515-aadb-92fe9781d424 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:41 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb73c61b-df21-4515-aadb-92fe9781d424 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 Jul 08 03:51:41 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:41 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.784s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:42 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2 Jul 08 03:51:42 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:42 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb73c61b-df21-4515-aadb-92fe9781d424 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:42 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 is being set with open permissions: ugo+rw Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:42 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 Jul 08 03:51:42 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:42 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-94268700-0e0a-43ca-bd4c-3109ab5c26a2" returned: 0 in 0.696s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-94268700-0e0a-43ca-bd4c-3109ab5c26a2" released by "delete_volume" :: held 1.537s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Created reservations ['94dbf7ba-071c-4a06-acfe-ee7e08934043', 'f3a5cfe4-7fbe-4669-975c-8eaad161cd2c', '225b7083-1b13-4b16-bef1-2f01d270c2a1', 'cc915036-9376-4d87-a366-399962e1793b'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:42 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837" returned: 0 in 0.688s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:42 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info Jul 08 03:51:42 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:42 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:42 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-05840e84-9667-4bd5-98cb-bc5f259ac727-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-05840e84-9667-4bd5-98cb-bc5f259ac727-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "cinder-quobyte-05840e84-9667-4bd5-98cb-bc5f259ac727" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-05840e84-9667-4bd5-98cb-bc5f259ac727" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1da7a7-c0e1-4e41-887f-937803152192]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:43 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:43 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info is being set with open permissions: ugo+rw Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:43 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info Jul 08 03:51:43 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:43 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.681s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Deleted volume successfully. Jul 08 03:51:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-dd69d01b-ea94-4957-a432-26ae38263c6b tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-94268700-0e0a-43ca-bd4c-3109ab5c26a2-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:43 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 Jul 08 03:51:43 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:44 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.info" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.709s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Creating offline snapshot e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb of volume 8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:51:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ee205266-8a58-458e-98fe-2b8483a227ef tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d4c5ef-495e-4dd8-ab33-0ee292eb525c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:44 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727" returned: 0 in 0.780s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:44 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727 Jul 08 03:51:44 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:44 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf Jul 08 03:51:44 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:44 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-05840e84-9667-4bd5-98cb-bc5f259ac727" returned: 0 in 0.676s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-quobyte-05840e84-9667-4bd5-98cb-bc5f259ac727" released by "delete_volume" :: held 1.494s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Created reservations ['da5acb15-de26-4bd9-b34a-1145ae3a9014', '22f048dd-8f5f-4429-a1db-3b2b82c6d1f6', '362c7628-459d-4eee-a3ed-8dc47dd63722', 'b1cff461-b0b9-4ed2-a553-8a61cf87cd63'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:44 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" returned: 0 in 0.775s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:45 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb 1G Jul 08 03:51:45 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:45 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:45 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-e3fe6180-c097-4b6e-b480-f4b8c3761837-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-e3fe6180-c097-4b6e-b480-f4b8c3761837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-cb73c61b-df21-4515-aadb-92fe9781d424" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-cb73c61b-df21-4515-aadb-92fe9781d424" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-e3fe6180-c097-4b6e-b480-f4b8c3761837" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-e3fe6180-c097-4b6e-b480-f4b8c3761837" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot e3fe6180-c097-4b6e-b480-f4b8c3761837 of volume cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd94e272-6129-40ee-a916-542a006b8539]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:45 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 Jul 08 03:51:45 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:45 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.749s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:45 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Deleted volume successfully. Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9c70c5ce-5abd-4e22-befb-9b886029a8ab tempest-VolumeDependencyTests-1029283513 None] Lock "cinder-05840e84-9667-4bd5-98cb-bc5f259ac727-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:45 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb 1G" returned: 0 in 0.930s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:45 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb Jul 08 03:51:45 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:46 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837" returned: 0 in 0.850s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb73c61b-df21-4515-aadb-92fe9781d424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ef10c2-efea-40d5-9a4e-9f7c21362ac2]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:46 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 Jul 08 03:51:46 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:46 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" returned: 0 in 0.778s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:46 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb is being set with open permissions: ugo+rw Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:46 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb Jul 08 03:51:46 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:47 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:47 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:47 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424" returned: 0 in 0.914s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:47 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 Jul 08 03:51:47 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:47 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" returned: 0 in 0.699s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:47 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info Jul 08 03:51:47 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:47 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.742s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:51:47 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837" returned: 0 in 0.826s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:47 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837 Jul 08 03:51:47 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:48 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info" returned: 0 in 0.700s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:48 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info is being set with open permissions: ugo+rw Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:48 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info Jul 08 03:51:48 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:48 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424.e3fe6180-c097-4b6e-b480-f4b8c3761837" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-e3fe6180-c097-4b6e-b480-f4b8c3761837" released by "_delete_snapshot" :: held 3.343s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-cb73c61b-df21-4515-aadb-92fe9781d424" released by "delete_snapshot" :: held 3.367s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Created reservations ['a470ae8b-a2fb-49ec-80d6-4c5777582cca', 'ec1cbdb0-85c0-47a0-8814-775ed98c87c2', '5599c4a9-ee20-4543-96af-e5ae897c3175', 'fae134d2-55cc-42bb-a4ff-0d8a1dc6000f'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3e9ee665-9830-4675-a799-7e4d50138e94 tempest-ProjectMemberTests-45241866 None] Lock "cinder-e3fe6180-c097-4b6e-b480-f4b8c3761837-delete_snapshot" released by "delete_snapshot" :: held 3.497s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:48 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.info" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.622s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-10bcddc8-5288-4d26-ae2f-cff6f1d1b280 tempest-CinderUnicodeTest-1806456910 None] Create snapshot completed successfully Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-cb73c61b-df21-4515-aadb-92fe9781d424-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Lock "cinder-cb73c61b-df21-4515-aadb-92fe9781d424-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-cb73c61b-df21-4515-aadb-92fe9781d424" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-cb73c61b-df21-4515-aadb-92fe9781d424" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7819f50f-e112-4f76-8c6e-7187fa733070]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:49 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 Jul 08 03:51:49 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-quobyte-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-quobyte-e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Deleting offline snapshot e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb of volume 8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] snapshot_file for this snap is: volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e423950-1cdb-4525-8eb5-ad2f9c99f7b3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:50 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb Jul 08 03:51:50 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:50 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:50 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424 Jul 08 03:51:50 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:50 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf863d12-3b30-4755-964a-ba498c46bef3]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:50 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf Jul 08 03:51:50 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:50 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-cb73c61b-df21-4515-aadb-92fe9781d424" returned: 0 in 0.630s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-cb73c61b-df21-4515-aadb-92fe9781d424" released by "delete_volume" :: held 1.447s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:50 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Created reservations ['a6dedb51-f295-4074-bf95-e4050eb00e0c', '4810bab5-29e5-49d0-8686-4ec51d8791dd', 'a436ad80-4a41-479c-87b2-410c864c5d65', '774e322f-5e92-4914-9786-bc9d01623238'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:51 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:51 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:51 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" returned: 0 in 0.756s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:51 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb Jul 08 03:51:51 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:51 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.640s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:51:51 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1c1fe804-ca75-4025-97b6-a16790d55093 tempest-ProjectMemberTests-45241866 None] Lock "cinder-cb73c61b-df21-4515-aadb-92fe9781d424-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (504b0f26-b681-49c3-9686-efab82f25ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215caea0-e0a7-4c87-abb1-d5d7c7e4371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215caea0-e0a7-4c87-abb1-d5d7c7e4371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798897592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8644b5-ae73-431f-936d-984b6df3c2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:52Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cc57e0-1299-4af8-abfe-07c154b02d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cc57e0-1299-4af8-abfe-07c154b02d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a1b21-1ede-4b58-8680-e82a8a79e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a1b21-1ede-4b58-8680-e82a8a79e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8644b5-ae73-431f-936d-984b6df3c2c1', 'volume_name': 'volume-2e8644b5-ae73-431f-936d-984b6df3c2c1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6ca44c-a3e6-430f-bcdd-b2f020240440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6ca44c-a3e6-430f-bcdd-b2f020240440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9281c45c-ad8a-415a-9510-14705b9580a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:52 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Volume 2e8644b5-ae73-431f-936d-984b6df3c2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8644b5-ae73-431f-936d-984b6df3c2c1', 'volume_size': 1} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798897592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8644b5-ae73-431f-936d-984b6df3c2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:51:52Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Creating volume 2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:51:52 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:52 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 1073741824 Jul 08 03:51:52 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:52 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" returned: 0 in 0.769s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:52 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb Jul 08 03:51:52 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:52 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf.e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb" released by "_delete_snapshot" :: held 3.067s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" released by "delete_snapshot" :: held 3.091s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:53 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 1073741824" returned: 0 in 0.856s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Created reservations ['4839ccfe-dab3-4519-9467-975590a10d25', 'f94e3e1d-1020-443c-af69-5f06dbf4c566', '953d7d6d-d4e3-4625-bd17-cd3eb5188f97', '0f99cd03-f24b-4bce-b1f1-b1d3c30b1a04'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:53 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 Jul 08 03:51:53 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Delete snapshot completed successfully. Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-ed3ec89e-1f51-4cb1-864d-d4e02d17a0ac tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-e0ebf0cd-adae-48f8-a91b-a9b0bba21bcb-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:53 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1" returned: 0 in 0.656s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9281c45c-ad8a-415a-9510-14705b9580a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8644b5-ae73-431f-936d-984b6df3c2c1', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3f078f-a9ff-4ad9-a24b-22b426be4706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:51:53 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Volume volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 (2e8644b5-ae73-431f-936d-984b6df3c2c1): created successfully Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3f078f-a9ff-4ad9-a24b-22b426be4706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:51:53 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (504b0f26-b681-49c3-9686-efab82f25ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:51:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-283d20dc-819e-4c26-bd1f-790e570f815a tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-quobyte-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2debe467-eb79-4238-b999-cd4c4b4e4d83]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:54 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf Jul 08 03:51:54 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Creating offline snapshot 9be01658-cc1d-45b2-8baa-8e5b0ec638f2 of volume 2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1015bb-1aa5-4374-91df-999851a063e5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:54 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 Jul 08 03:51:54 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:54 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" returned: 0 in 0.778s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:55 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf Jul 08 03:51:55 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:55 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1" returned: 0 in 0.763s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:55 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 1G Jul 08 03:51:55 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:55 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" returned: 0 in 0.642s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf" released by "delete_volume" :: held 1.483s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Created reservations ['98d52247-4149-4785-a514-5a92c310705b', '28f42573-345f-4363-b17f-08f3e0e3d148', 'fb3981c2-328c-4b24-a055-df981fd1020b', '55a049e6-9819-428c-bd31-e17ad1760419'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:55 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:55 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:55 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 1G" returned: 0 in 0.832s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:56 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 Jul 08 03:51:56 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-f307f8bf-23dd-4c62-b0b9-96c774e7cc79-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-f307f8bf-23dd-4c62-b0b9-96c774e7cc79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "cinder-quobyte-f307f8bf-23dd-4c62-b0b9-96c774e7cc79" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-f307f8bf-23dd-4c62-b0b9-96c774e7cc79" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:56 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.710s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[113e81a8-8799-4829-a176-f606c772a1fe]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Deleted volume successfully. Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-200025bb-e62b-4b97-a049-a9785dff3ef1 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-8dd314f6-7b6b-4f4b-a944-a9ea04e22bcf-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:56 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 Jul 08 03:51:56 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:56 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2" returned: 0 in 0.704s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:56 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 is being set with open permissions: ugo+rw Jul 08 03:51:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:56 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 Jul 08 03:51:56 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:57 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79" returned: 0 in 0.794s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:57 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79 Jul 08 03:51:57 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:57 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2" returned: 0 in 0.662s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:57 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info Jul 08 03:51:57 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:57 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-f307f8bf-23dd-4c62-b0b9-96c774e7cc79" returned: 0 in 0.669s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-quobyte-f307f8bf-23dd-4c62-b0b9-96c774e7cc79" released by "delete_volume" :: held 1.508s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Created reservations ['456e5658-82ad-4942-99f8-589fef8a5d41', 'a0abb629-1bb5-4635-9f79-8b0cdf8685db', '414ae366-8adc-4692-9345-4d47071c8f5c', 'ae142ee7-8e28-45c1-acd8-bbbffc4f7d19'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:51:58 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info" returned: 0 in 0.646s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:58 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info is being set with open permissions: ugo+rw Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:58 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info Jul 08 03:51:58 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:58 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:51:58 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:51:58 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.info" returned: 0 in 0.656s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.343s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:51:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d890c3bc-936f-4c14-b3bf-ada7cc23401a tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:51:58 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.664s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:51:58 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Deleted volume successfully. Jul 08 03:51:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-90946b0c-a8ec-4191-b42b-64dc3a2cb5d7 tempest-CinderUnicodeTest-1806456910 None] Lock "cinder-f307f8bf-23dd-4c62-b0b9-96c774e7cc79-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-9be01658-cc1d-45b2-8baa-8e5b0ec638f2-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Lock "cinder-9be01658-cc1d-45b2-8baa-8e5b0ec638f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-2e8644b5-ae73-431f-936d-984b6df3c2c1" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-2e8644b5-ae73-431f-936d-984b6df3c2c1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-9be01658-cc1d-45b2-8baa-8e5b0ec638f2" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-9be01658-cc1d-45b2-8baa-8e5b0ec638f2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot 9be01658-cc1d-45b2-8baa-8e5b0ec638f2 of volume 2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab879b7-db35-4bcc-8be3-834e47522711]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:51:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:51:59 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 Jul 08 03:51:59 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:00 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2" returned: 0 in 0.769s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:00 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e8644b5-ae73-431f-936d-984b6df3c2c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:52:00 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c422448-cef9-40f5-84c4-1fb080590dfb]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:00 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 Jul 08 03:52:00 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:01 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1" returned: 0 in 0.756s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:01 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 Jul 08 03:52:01 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-35eec274-3844-42fb-a571-ffcaadec61c5 tempest-ProjectAdminTests-1887020203 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86294) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 03:52:01 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2" returned: 0 in 0.709s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:02 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2 Jul 08 03:52:02 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:02 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1.9be01658-cc1d-45b2-8baa-8e5b0ec638f2" returned: 0 in 0.623s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-9be01658-cc1d-45b2-8baa-8e5b0ec638f2" released by "_delete_snapshot" :: held 2.950s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-2e8644b5-ae73-431f-936d-984b6df3c2c1" released by "delete_snapshot" :: held 2.974s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Created reservations ['bec10660-8e18-496f-b67b-f8532140b508', '64834ba4-02b0-4651-80fe-e32742aeca4d', 'e0338f2f-a67c-4f48-981e-104002221248', 'a3920721-5af5-4782-84ef-18a439cf7ec8'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-5cb75e16-41d1-4df5-9373-2f511e6341e2 tempest-ProjectMemberTests-45241866 None] Lock "cinder-9be01658-cc1d-45b2-8baa-8e5b0ec638f2-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-2e8644b5-ae73-431f-936d-984b6df3c2c1-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Lock "cinder-2e8644b5-ae73-431f-936d-984b6df3c2c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-2e8644b5-ae73-431f-936d-984b6df3c2c1" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-2e8644b5-ae73-431f-936d-984b6df3c2c1" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e6f0d-d435-4067-9579-bb2d15a50a4b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:03 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 Jul 08 03:52:03 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:03 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1" returned: 0 in 0.800s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:03 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1 Jul 08 03:52:03 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:04 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-2e8644b5-ae73-431f-936d-984b6df3c2c1" returned: 0 in 0.664s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-2e8644b5-ae73-431f-936d-984b6df3c2c1" released by "delete_volume" :: held 1.530s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Created reservations ['4aad4479-460e-487e-ad81-712c6d064de5', '49e579cd-db9a-4b0b-b191-eb868afe5ed3', 'd16d6c16-39b5-44da-819a-fc0bfd865e7a', 'b0e12595-c040-4e46-805e-4830ce75778c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:04 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:52:04 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:05 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.663s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:52:05 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-931b180d-519c-4ca4-a903-66d2fd64daa7 tempest-ProjectMemberTests-45241866 None] Lock "cinder-2e8644b5-ae73-431f-936d-984b6df3c2c1-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (ce64bc12-360b-47f7-956b-8653b0d842b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97b777a-bf32-4e12-bf90-99c7626eec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97b777a-bf32-4e12-bf90-99c7626eec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761511422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65f4260-5a47-4017-b543-36da0cd8a3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:06Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44139445-3338-4548-a711-26aba567bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44139445-3338-4548-a711-26aba567bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3028820-d93e-4ef9-85a4-2964261d64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3028820-d93e-4ef9-85a4-2964261d64fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65f4260-5a47-4017-b543-36da0cd8a3a0', 'volume_name': 'volume-e65f4260-5a47-4017-b543-36da0cd8a3a0', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e58b86-ba93-4a67-9d03-14707430cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e58b86-ba93-4a67-9d03-14707430cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66853fb4-2f10-4b9e-a033-cfd0ff74b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:05 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Volume e65f4260-5a47-4017-b543-36da0cd8a3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65f4260-5a47-4017-b543-36da0cd8a3a0', 'volume_size': 1} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761511422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65f4260-5a47-4017-b543-36da0cd8a3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:06Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Creating volume e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:52:05 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:52:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:05 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 1073741824 Jul 08 03:52:05 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:06 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 1073741824" returned: 0 in 0.852s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:06 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 Jul 08 03:52:06 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:07 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66853fb4-2f10-4b9e-a033-cfd0ff74b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65f4260-5a47-4017-b543-36da0cd8a3a0', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f3be4-5a97-4311-ab2f-16c3c0ed1329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:07 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Volume volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 (e65f4260-5a47-4017-b543-36da0cd8a3a0): created successfully Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f3be4-5a97-4311-ab2f-16c3c0ed1329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (ce64bc12-360b-47f7-956b-8653b0d842b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:07 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-82da9738-4db0-4590-acd3-7409bbf94282 tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Creating offline snapshot 27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 of volume e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a82262-d461-4cde-bd75-ea95bf6fc626]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:07 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 Jul 08 03:52:07 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:08 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0" returned: 0 in 0.766s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:08 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 1G Jul 08 03:52:08 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:09 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 1G" returned: 0 in 0.854s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:09 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 Jul 08 03:52:09 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:10 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:10 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 is being set with open permissions: ugo+rw Jul 08 03:52:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:10 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 Jul 08 03:52:10 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:10 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" returned: 0 in 0.646s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:10 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info Jul 08 03:52:10 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:11 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info" returned: 0 in 0.683s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:11 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info is being set with open permissions: ugo+rw Jul 08 03:52:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:11 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info Jul 08 03:52:11 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:12 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.info" returned: 0 in 0.657s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.374s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-24628a52-c2ce-4857-bb7e-e80c5adbb8b3 tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Lock "cinder-27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-e65f4260-5a47-4017-b543-36da0cd8a3a0" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-e65f4260-5a47-4017-b543-36da0cd8a3a0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot 27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 of volume e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78d7b8-e738-49a7-9171-aed33d115f8f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:13 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 Jul 08 03:52:13 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:13 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" returned: 0 in 0.798s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65f4260-5a47-4017-b543-36da0cd8a3a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b4fe90-71e8-4fac-8632-9e80f823e611]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:14 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 Jul 08 03:52:14 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:14 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0" returned: 0 in 0.794s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:14 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 Jul 08 03:52:14 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:15 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" returned: 0 in 0.733s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:15 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687 Jul 08 03:52:15 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:16 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0.27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" returned: 0 in 0.665s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687" released by "_delete_snapshot" :: held 3.092s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-e65f4260-5a47-4017-b543-36da0cd8a3a0" released by "delete_snapshot" :: held 3.116s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:16 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Created reservations ['fd60aaa0-3b72-4e1e-97bc-0735ea09d4e0', '9b7bc91e-db05-4936-bc11-ea3993807271', '966af766-ac2a-48e3-88d8-15632513f3b5', '3f650fad-6474-49a9-861d-d0a47766c7e5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:16 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:52:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8fe52566-a1aa-468a-abad-c950124dd031 tempest-ProjectMemberTests-45241866 None] Lock "cinder-27cd6ce2-d7a4-45cd-a9c5-fa1a259a5687-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-e65f4260-5a47-4017-b543-36da0cd8a3a0-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Lock "cinder-e65f4260-5a47-4017-b543-36da0cd8a3a0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-e65f4260-5a47-4017-b543-36da0cd8a3a0" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:17 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-e65f4260-5a47-4017-b543-36da0cd8a3a0" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c11a8-6005-4321-9082-12653c259df0]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:17 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 Jul 08 03:52:17 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:18 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0" returned: 0 in 0.751s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:18 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0 Jul 08 03:52:18 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:18 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-e65f4260-5a47-4017-b543-36da0cd8a3a0" returned: 0 in 0.659s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-e65f4260-5a47-4017-b543-36da0cd8a3a0" released by "delete_volume" :: held 1.472s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Created reservations ['a41cba80-430f-4478-b114-e7471016d098', '3cf73877-d784-465e-b713-6ad865e613bf', '7a70591e-f047-47a1-bd86-e8f950e03b57', 'bdb0ee68-9a92-4187-ae04-050d6329237d'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:18 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:52:18 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:19 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.677s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:19 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:52:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:52:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d45fc43-8b43-4a47-877f-29d319bce9c3 tempest-ProjectMemberTests-45241866 None] Lock "cinder-e65f4260-5a47-4017-b543-36da0cd8a3a0-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (8e6fdbb3-139d-4878-966e-15c67a9838af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28177531-5d82-495a-bc97-6eff46e5f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28177531-5d82-495a-bc97-6eff46e5f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161183885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:20Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a14c66-88ec-442f-9ee0-6c01f87a449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a14c66-88ec-442f-9ee0-6c01f87a449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1afd23a-c71b-465b-8692-bcf735b377bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1afd23a-c71b-465b-8692-bcf735b377bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6', 'volume_name': 'volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3f6bd1-af97-4591-8a44-1921c6399ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3f6bd1-af97-4591-8a44-1921c6399ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc25c98-963b-4afc-922e-3b3da0fdd92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:20 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Volume 32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6', 'volume_size': 1} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161183885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:20Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Creating volume 32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:52:20 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:20 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 1073741824 Jul 08 03:52:20 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:20 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 1073741824" returned: 0 in 0.798s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:20 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 Jul 08 03:52:20 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:21 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" returned: 0 in 0.628s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc25c98-963b-4afc-922e-3b3da0fdd92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87971d54-53c4-49d5-acce-e40042c70e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:21 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Volume volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 (32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6): created successfully Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87971d54-53c4-49d5-acce-e40042c70e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:21 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (8e6fdbb3-139d-4878-966e-15c67a9838af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:21 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-945f0e6b-ebdd-41f1-9194-06923a2f6343 tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:52:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:22 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Creating offline snapshot 66fdf80e-5d49-411d-b083-8c5bca772b52 of volume 32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:52:22 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[14afa1e8-293d-45cf-bca7-5b84aeaabe28]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:22 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 Jul 08 03:52:22 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:23 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" returned: 0 in 0.741s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:23 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 1G Jul 08 03:52:23 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:23 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 1G" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:23 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 Jul 08 03:52:23 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:24 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52" returned: 0 in 0.667s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:24 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 is being set with open permissions: ugo+rw Jul 08 03:52:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:24 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 Jul 08 03:52:24 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:25 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52" returned: 0 in 0.611s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:25 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info Jul 08 03:52:25 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:25 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info" returned: 0 in 0.631s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:25 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info is being set with open permissions: ugo+rw Jul 08 03:52:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:25 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info Jul 08 03:52:25 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:26 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.info" returned: 0 in 0.631s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.130s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-82080fc0-4002-414c-988f-58e572786ad0 tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-66fdf80e-5d49-411d-b083-8c5bca772b52-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Lock "cinder-66fdf80e-5d49-411d-b083-8c5bca772b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-66fdf80e-5d49-411d-b083-8c5bca772b52" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-66fdf80e-5d49-411d-b083-8c5bca772b52" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot 66fdf80e-5d49-411d-b083-8c5bca772b52 of volume 32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e5fa71-aed6-404b-bc6d-c2f937c29f6b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:27 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 Jul 08 03:52:27 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:28 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52" returned: 0 in 0.726s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:52:28 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a5fb5-4d12-48ff-b4f6-db3887d1bc67]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:28 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 Jul 08 03:52:28 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:29 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" returned: 0 in 0.735s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:29 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 Jul 08 03:52:29 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:29 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52" returned: 0 in 0.706s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:29 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52 Jul 08 03:52:29 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:30 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6.66fdf80e-5d49-411d-b083-8c5bca772b52" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-66fdf80e-5d49-411d-b083-8c5bca772b52" released by "_delete_snapshot" :: held 2.892s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" released by "delete_snapshot" :: held 2.913s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=85,cinder:UPDATE=105,cinder:DELETE=6,cinder:INSERT=28 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Created reservations ['b9a5527a-6007-41af-bdbe-c0eaa0063475', '4274df99-2d96-467c-a30b-6a5631cda1aa', '7a2fcdb0-25f3-4762-80b3-37da47bcadb5', '93b5807c-243d-48bd-96ed-7d28b75f145e'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:30 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-de1c2bf5-6b22-4edc-8508-c0a9c953dd81 tempest-ProjectMemberTests-45241866 None] Lock "cinder-66fdf80e-5d49-411d-b083-8c5bca772b52-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Lock "cinder-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e3630-512f-4130-bd9a-33c79323c57e]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:30 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 Jul 08 03:52:30 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:31 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" returned: 0 in 0.742s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:31 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6 Jul 08 03:52:31 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:32 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" returned: 0 in 0.618s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6" released by "delete_volume" :: held 1.413s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Created reservations ['c27a4528-1e46-4723-a1d0-3d312c2e0b7b', 'd64f5220-0d22-476c-8297-fad2b92d8083', '232f64e4-089d-4401-9e66-84514868550a', 'b71f32cc-4eee-4465-ba25-528ccb52ee20'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:32 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:52:32 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:32 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.631s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:52:32 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:52:32 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f3db93c8-3022-49e8-9f39-cda07e77dffa tempest-ProjectMemberTests-45241866 None] Lock "cinder-32c4edd8-b1b5-4f2e-800d-d25b8ebbbaf6-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (2cd7a522-0681-45ba-b378-de7d77916459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48c9a9e-aaf8-4ea5-a28f-5dbf280c6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48c9a9e-aaf8-4ea5-a28f-5dbf280c6e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288663441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ade501d-066a-4658-82b5-4c8b5805642d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:33Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a318e7-7ba0-4536-a709-50f2a4e50342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a318e7-7ba0-4536-a709-50f2a4e50342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1076c401-1276-4f97-bde7-45c35769e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1076c401-1276-4f97-bde7-45c35769e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ade501d-066a-4658-82b5-4c8b5805642d', 'volume_name': 'volume-7ade501d-066a-4658-82b5-4c8b5805642d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25261902-838e-4d2b-998a-1b653882072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25261902-838e-4d2b-998a-1b653882072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23ae669-a35b-4a7f-936d-b869596ce0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:33 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Volume 7ade501d-066a-4658-82b5-4c8b5805642d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ade501d-066a-4658-82b5-4c8b5805642d', 'volume_size': 1} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288663441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ade501d-066a-4658-82b5-4c8b5805642d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:33Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Creating volume 7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:52:33 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:52:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:33 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d 1073741824 Jul 08 03:52:33 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:34 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d 1073741824" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:34 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d Jul 08 03:52:34 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:34 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d" returned: 0 in 0.629s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23ae669-a35b-4a7f-936d-b869596ce0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ade501d-066a-4658-82b5-4c8b5805642d', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0869ed71-3f97-4757-b95b-b5aaccd4cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Volume volume-7ade501d-066a-4658-82b5-4c8b5805642d (7ade501d-066a-4658-82b5-4c8b5805642d): created successfully Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0869ed71-3f97-4757-b95b-b5aaccd4cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (2cd7a522-0681-45ba-b378-de7d77916459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-084fd187-5e23-4717-b289-5b0d8dded34f tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:52:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:35 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Creating offline snapshot f5c07a47-5683-4629-8cb4-ee6ee72db5b1 of volume 7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:52:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e64547-3c7b-4a08-9dc2-10736fd3cc04]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:35 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d Jul 08 03:52:35 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:36 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d" returned: 0 in 0.740s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:36 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 1G Jul 08 03:52:36 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:36 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 1G" returned: 0 in 0.760s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ade501d-066a-4658-82b5-4c8b5805642d -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:37 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ade501d-066a-4658-82b5-4c8b5805642d -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 Jul 08 03:52:37 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:37 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ade501d-066a-4658-82b5-4c8b5805642d -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1" returned: 0 in 0.656s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:37 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 is being set with open permissions: ugo+rw Jul 08 03:52:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:37 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 Jul 08 03:52:37 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:38 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:38 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:DELETE=14,cinder:UPDATE=125,cinder:INSERT=36,cinder:SELECT=95 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:52:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:38 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info Jul 08 03:52:38 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:38 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info" returned: 0 in 0.650s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:38 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info is being set with open permissions: ugo+rw Jul 08 03:52:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:39 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info Jul 08 03:52:39 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:39 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.info" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.177s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ebbe3d66-d6ec-4782-9ee6-b9e77b1235bd tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-f5c07a47-5683-4629-8cb4-ee6ee72db5b1-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Lock "cinder-f5c07a47-5683-4629-8cb4-ee6ee72db5b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-7ade501d-066a-4658-82b5-4c8b5805642d" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-7ade501d-066a-4658-82b5-4c8b5805642d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-f5c07a47-5683-4629-8cb4-ee6ee72db5b1" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-f5c07a47-5683-4629-8cb4-ee6ee72db5b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot f5c07a47-5683-4629-8cb4-ee6ee72db5b1 of volume 7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb73e2-4ccc-4601-b59e-2ff3b02e9f36]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:40 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 Jul 08 03:52:40 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:41 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1" returned: 0 in 0.753s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ade501d-066a-4658-82b5-4c8b5805642d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:52:41 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6af62be-5b3e-4099-9ea8-f4faf0caa23f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:41 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d Jul 08 03:52:41 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:42 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d" returned: 0 in 0.735s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:42 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 Jul 08 03:52:42 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:43 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1" returned: 0 in 0.739s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:43 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1 Jul 08 03:52:43 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:43 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d.f5c07a47-5683-4629-8cb4-ee6ee72db5b1" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-f5c07a47-5683-4629-8cb4-ee6ee72db5b1" released by "_delete_snapshot" :: held 2.946s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-7ade501d-066a-4658-82b5-4c8b5805642d" released by "delete_snapshot" :: held 2.968s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Created reservations ['4a133850-2fda-4087-9d8d-75966502d394', 'bf229a0f-d67a-48c2-a0c3-b13c3bcb932a', 'f70f2091-c2c0-4962-87a8-23f48d745506', 'edcef0fe-270a-4b55-b120-58553c76c73a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:43 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-a843112a-b8bb-4eae-942a-6d11c741537d tempest-ProjectMemberTests-45241866 None] Lock "cinder-f5c07a47-5683-4629-8cb4-ee6ee72db5b1-delete_snapshot" released by "delete_snapshot" :: held 3.094s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-7ade501d-066a-4658-82b5-4c8b5805642d-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Lock "cinder-7ade501d-066a-4658-82b5-4c8b5805642d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-7ade501d-066a-4658-82b5-4c8b5805642d" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-7ade501d-066a-4658-82b5-4c8b5805642d" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[358762d4-92a0-42dd-b4c7-4e483e25df2b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:44 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d Jul 08 03:52:44 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:44 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d" returned: 0 in 0.745s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:44 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d Jul 08 03:52:44 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:45 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-7ade501d-066a-4658-82b5-4c8b5805642d" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-7ade501d-066a-4658-82b5-4c8b5805642d" released by "delete_volume" :: held 1.433s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Created reservations ['f9756c82-bf74-46a6-80c1-5b9c8d9a5682', 'ac3dbb80-a637-41b3-a8d9-ad22a8c3279c', '07a874b6-30bc-47d9-87ac-6fc69d05559d', '976176ce-6af8-4124-bfc8-599e290236d2'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:45 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:52:45 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:46 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.632s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:52:46 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0d13291c-9d55-4b94-b4f1-57e38e42bb2e tempest-ProjectMemberTests-45241866 None] Lock "cinder-7ade501d-066a-4658-82b5-4c8b5805642d-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (08fe8091-1e39-4567-a18e-f723059e81a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20af16c-ca6f-4fd7-ae77-01a6e4e117fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20af16c-ca6f-4fd7-ae77-01a6e4e117fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268873682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1053931a-d997-4cf5-a70d-d8edd1412562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:46Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36d7632-3cf7-4d4c-a9d8-3fbcb71c2334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36d7632-3cf7-4d4c-a9d8-3fbcb71c2334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af628a24-daf3-4fc3-9544-8593b7ec00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af628a24-daf3-4fc3-9544-8593b7ec00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1053931a-d997-4cf5-a70d-d8edd1412562', 'volume_name': 'volume-1053931a-d997-4cf5-a70d-d8edd1412562', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011bd38a-7701-43a2-ac4b-bef1931789c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011bd38a-7701-43a2-ac4b-bef1931789c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4763b162-a2cf-4f6b-bbb0-c0a9f7478d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:46 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Volume 1053931a-d997-4cf5-a70d-d8edd1412562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1053931a-d997-4cf5-a70d-d8edd1412562', 'volume_size': 1} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268873682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1053931a-d997-4cf5-a70d-d8edd1412562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:52:46Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Creating volume 1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:52:46 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:46 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 1073741824 Jul 08 03:52:46 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:46 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:47 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:52:47 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:47 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 1073741824" returned: 0 in 0.826s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:47 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 Jul 08 03:52:47 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:47 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.662s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:52:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:52:48 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562" returned: 0 in 0.667s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4763b162-a2cf-4f6b-bbb0-c0a9f7478d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1053931a-d997-4cf5-a70d-d8edd1412562', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dba326b-77ce-4453-bd01-0558869011e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:48 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Volume volume-1053931a-d997-4cf5-a70d-d8edd1412562 (1053931a-d997-4cf5-a70d-d8edd1412562): created successfully Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dba326b-77ce-4453-bd01-0558869011e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (08fe8091-1e39-4567-a18e-f723059e81a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:48 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-31b79322-f00e-44db-b3e1-1930fc9786ca tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Creating offline snapshot 26e904a1-ff51-4a53-a289-a369727ddd40 of volume 1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c18c0c-9d7f-4286-95b6-7f4c5c757e45]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:48 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 Jul 08 03:52:48 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:49 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562" returned: 0 in 0.771s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:49 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 1G Jul 08 03:52:49 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:50 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 1G" returned: 0 in 0.786s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1053931a-d997-4cf5-a70d-d8edd1412562 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:50 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1053931a-d997-4cf5-a70d-d8edd1412562 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 Jul 08 03:52:50 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:50 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1053931a-d997-4cf5-a70d-d8edd1412562 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40" returned: 0 in 0.684s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:50 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 is being set with open permissions: ugo+rw Jul 08 03:52:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:51 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 Jul 08 03:52:51 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:51 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:51 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info Jul 08 03:52:51 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:52 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:52 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info is being set with open permissions: ugo+rw Jul 08 03:52:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:52 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info Jul 08 03:52:52 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:52 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.info" returned: 0 in 0.648s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.265s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:52 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a53653a7-7bf9-449a-b2a1-9a9adb25e0e4 tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-26e904a1-ff51-4a53-a289-a369727ddd40-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Lock "cinder-26e904a1-ff51-4a53-a289-a369727ddd40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-1053931a-d997-4cf5-a70d-d8edd1412562" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-1053931a-d997-4cf5-a70d-d8edd1412562" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-26e904a1-ff51-4a53-a289-a369727ddd40" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-26e904a1-ff51-4a53-a289-a369727ddd40" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:53 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot 26e904a1-ff51-4a53-a289-a369727ddd40 of volume 1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fca8c4-8485-404e-b39a-e22612180aae]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:54 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 Jul 08 03:52:54 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:54 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1053931a-d997-4cf5-a70d-d8edd1412562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e25eaf-6a64-45b2-9d7f-5b006f0943d1]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:54 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 Jul 08 03:52:54 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:55 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562" returned: 0 in 0.741s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:55 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 Jul 08 03:52:55 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:56 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40" returned: 0 in 0.724s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:56 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40 Jul 08 03:52:56 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:56 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562.26e904a1-ff51-4a53-a289-a369727ddd40" returned: 0 in 0.633s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-26e904a1-ff51-4a53-a289-a369727ddd40" released by "_delete_snapshot" :: held 2.921s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:56 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-1053931a-d997-4cf5-a70d-d8edd1412562" released by "delete_snapshot" :: held 2.943s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:56 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Created reservations ['0c986d2f-1dea-4fcd-8167-f0ea458c7a1c', '1294791d-adca-4581-a79f-dfbd726a1dab', '8907b02f-b390-44b3-9039-912ec2cde2b6', 'aec2aaad-8d40-4dec-bc25-fd12dfec53df'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8c63f306-7213-4183-8807-e41bfe62f97d tempest-ProjectMemberTests-45241866 None] Lock "cinder-26e904a1-ff51-4a53-a289-a369727ddd40-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-1053931a-d997-4cf5-a70d-d8edd1412562-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Lock "cinder-1053931a-d997-4cf5-a70d-d8edd1412562-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-1053931a-d997-4cf5-a70d-d8edd1412562" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-1053931a-d997-4cf5-a70d-d8edd1412562" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cb92fa-305f-4fd0-8ef0-e80f7dad3d5c]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:57 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 Jul 08 03:52:57 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:57 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562" returned: 0 in 0.767s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:58 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562 Jul 08 03:52:58 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:58 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-1053931a-d997-4cf5-a70d-d8edd1412562" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-1053931a-d997-4cf5-a70d-d8edd1412562" released by "delete_volume" :: held 1.459s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Created reservations ['a636f9b6-892d-4ea9-b9a0-f1bdc0717887', '542d6e97-12de-43d2-be56-e8622c1c3e9c', 'f9f6bb5d-4a1a-4e24-a55a-29eda7aaeaee', 'a366f950-1aae-46a5-8628-e92b65f98930'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:58 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:52:58 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:52:59 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.640s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:52:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1de5e74-8197-4141-8bdf-a07519c6b615 tempest-ProjectMemberTests-45241866 None] Lock "cinder-1053931a-d997-4cf5-a70d-d8edd1412562-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (1faa4f51-871f-4880-8330-6aa9ee25cf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bbbb82-abed-4d07-96f8-4c8a11cf8bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bbbb82-abed-4d07-96f8-4c8a11cf8bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475140328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeea5349-9925-4e60-b03f-82517093b3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:00Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00f2ce0-09dc-482f-9772-6f215ba587e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00f2ce0-09dc-482f-9772-6f215ba587e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf70931-e0d2-47af-b90e-a6dd5a0a4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf70931-e0d2-47af-b90e-a6dd5a0a4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeea5349-9925-4e60-b03f-82517093b3a3', 'volume_name': 'volume-eeea5349-9925-4e60-b03f-82517093b3a3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c0e12a-80c9-4bcb-a0f1-da319a9af45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c0e12a-80c9-4bcb-a0f1-da319a9af45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4539abb2-ab54-4e83-a698-52e48f77e162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:52:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Volume eeea5349-9925-4e60-b03f-82517093b3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeea5349-9925-4e60-b03f-82517093b3a3', 'volume_size': 1} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475140328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeea5349-9925-4e60-b03f-82517093b3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108d29dfaf464675863e95be3d0fd346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:00Z,use_quota=True,user_id='df40780aaa904a01a58dd95a6d629b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Creating volume eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:52:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:52:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:52:59 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 1073741824 Jul 08 03:52:59 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:00 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 1073741824" returned: 0 in 0.786s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:00 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 Jul 08 03:53:00 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:01 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3" returned: 0 in 0.623s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4539abb2-ab54-4e83-a698-52e48f77e162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeea5349-9925-4e60-b03f-82517093b3a3', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6418e6a-e0c7-4738-a3d3-13aadb2df63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Volume volume-eeea5349-9925-4e60-b03f-82517093b3a3 (eeea5349-9925-4e60-b03f-82517093b3a3): created successfully Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6418e6a-e0c7-4738-a3d3-13aadb2df63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Flow 'volume_create_manager' (1faa4f51-871f-4880-8330-6aa9ee25cf7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4495ff7e-dbef-4e18-8902-4128641f5be1 tempest-ProjectMemberTests-45241866 None] Created volume successfully. Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Creating offline snapshot 30ca1e1c-a952-4209-8cfe-5cf23feb5299 of volume eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:53:01 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff3b50-7846-4a9a-974a-b3deb52bcea4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:02 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 Jul 08 03:53:02 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:02 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3" returned: 0 in 0.732s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:02 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 1G Jul 08 03:53:02 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:03 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 1G" returned: 0 in 0.779s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeea5349-9925-4e60-b03f-82517093b3a3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:03 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeea5349-9925-4e60-b03f-82517093b3a3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 Jul 08 03:53:03 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:04 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeea5349-9925-4e60-b03f-82517093b3a3 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299" returned: 0 in 0.672s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:04 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 is being set with open permissions: ugo+rw Jul 08 03:53:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:04 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 Jul 08 03:53:04 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:04 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299" returned: 0 in 0.624s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:04 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info Jul 08 03:53:04 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:05 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:05 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info is being set with open permissions: ugo+rw Jul 08 03:53:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:05 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info Jul 08 03:53:05 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:06 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.info" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.162s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-2dab3658-d790-4d40-aa3a-54d1bc7c9637 tempest-ProjectMemberTests-45241866 None] Create snapshot completed successfully Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-30ca1e1c-a952-4209-8cfe-5cf23feb5299-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Lock "cinder-30ca1e1c-a952-4209-8cfe-5cf23feb5299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-eeea5349-9925-4e60-b03f-82517093b3a3" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-eeea5349-9925-4e60-b03f-82517093b3a3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-30ca1e1c-a952-4209-8cfe-5cf23feb5299" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-30ca1e1c-a952-4209-8cfe-5cf23feb5299" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Deleting offline snapshot 30ca1e1c-a952-4209-8cfe-5cf23feb5299 of volume eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] snapshot_file for this snap is: volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bc0cff-1cf0-4114-bc7a-c04b12048071]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:07 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 Jul 08 03:53:07 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:08 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299" returned: 0 in 0.739s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeea5349-9925-4e60-b03f-82517093b3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:53:08 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d7424b-43d8-4de0-8142-c0ed840cac51]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:08 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 Jul 08 03:53:08 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:08 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3" returned: 0 in 0.733s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:08 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 Jul 08 03:53:08 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:09 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299" returned: 0 in 0.727s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:09 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299 Jul 08 03:53:09 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:10 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3.30ca1e1c-a952-4209-8cfe-5cf23feb5299" returned: 0 in 0.631s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-30ca1e1c-a952-4209-8cfe-5cf23feb5299" released by "_delete_snapshot" :: held 2.917s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-eeea5349-9925-4e60-b03f-82517093b3a3" released by "delete_snapshot" :: held 2.943s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Created reservations ['b5ce63ad-2fd9-4185-91d0-265ebf499d94', '6b9c40fe-9ca4-4c0a-b1d2-c73b0efa05b9', '71983c1f-3f02-4023-85c8-7c37d585cec3', 'ecb9dabf-ad06-461c-8ae0-60c995adc346'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:10 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Delete snapshot completed successfully. Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-b0182ae9-9506-4a1c-9770-25d4bb521c7e tempest-ProjectMemberTests-45241866 None] Lock "cinder-30ca1e1c-a952-4209-8cfe-5cf23feb5299-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-eeea5349-9925-4e60-b03f-82517093b3a3-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Lock "cinder-eeea5349-9925-4e60-b03f-82517093b3a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Acquiring lock "cinder-quobyte-eeea5349-9925-4e60-b03f-82517093b3a3" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-eeea5349-9925-4e60-b03f-82517093b3a3" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6429846-7644-444a-92b1-d52c0e4a7e32]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:10 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 Jul 08 03:53:10 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:11 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3" returned: 0 in 0.737s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:11 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3 Jul 08 03:53:11 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:11 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-eeea5349-9925-4e60-b03f-82517093b3a3" returned: 0 in 0.630s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:11 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Lock "cinder-quobyte-eeea5349-9925-4e60-b03f-82517093b3a3" released by "delete_volume" :: held 1.423s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:11 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Created reservations ['3c31c21b-1f68-4a4f-b0a5-c9187b683028', '35c3a240-b1e4-4dc5-9fcf-a4327adeec39', '689e2abf-011c-4449-8e9a-d87033814201', 'b9168205-39de-4cdf-91af-657106c67f69'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:12 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:53:12 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:12 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:53:12 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Deleted volume successfully. Jul 08 03:53:12 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-618af69c-4fb5-4cc3-9a97-b009389bf63f tempest-ProjectMemberTests-45241866 None] Lock "cinder-eeea5349-9925-4e60-b03f-82517093b3a3-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (38133e2f-4292-46a0-a092-977f9492e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec89968-5cf6-4942-bf6e-6efc443288c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec89968-5cf6-4942-bf6e-6efc443288c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455873551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5283e2c-e77e-4a41-a0dc-4716c7889fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:16Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc88cf73-b58c-4297-8d47-9594b3e9199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc88cf73-b58c-4297-8d47-9594b3e9199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5f93df-bf5e-4e37-9592-ae764bfce2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5f93df-bf5e-4e37-9592-ae764bfce2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5283e2c-e77e-4a41-a0dc-4716c7889fb8', 'volume_name': 'volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50c6cf2-a98d-495d-8dc8-5b69939d322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50c6cf2-a98d-495d-8dc8-5b69939d322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e692ed74-ed10-46b5-89da-fc567c564cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:16 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Volume d5283e2c-e77e-4a41-a0dc-4716c7889fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8', 'volume_size': 1} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455873551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5283e2c-e77e-4a41-a0dc-4716c7889fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:16Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Creating volume d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:53:16 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:16 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 1073741824 Jul 08 03:53:16 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:16 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 1073741824" returned: 0 in 0.782s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:17 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 Jul 08 03:53:17 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:17 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" returned: 0 in 0.639s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e692ed74-ed10-46b5-89da-fc567c564cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5c0686-8493-496d-99e5-9bcf68e51801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:17 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Volume volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 (d5283e2c-e77e-4a41-a0dc-4716c7889fb8): created successfully Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5c0686-8493-496d-99e5-9bcf68e51801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:17 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (38133e2f-4292-46a0-a092-977f9492e884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:17 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-dc6d82f7-70a8-4055-b867-5b172390745e tempest-ProjectReaderTests-12287965 None] Created volume successfully. Jul 08 03:53:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:18 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Creating offline snapshot e4e534a9-602c-474f-b31c-de87202f2e2d of volume d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:53:18 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d0071-4c30-4acf-b3ed-31aebed44d0f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:18 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 Jul 08 03:53:18 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:19 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" returned: 0 in 0.734s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:19 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d 1G Jul 08 03:53:19 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:19 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d 1G" returned: 0 in 0.756s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:19 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d Jul 08 03:53:19 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:20 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d" returned: 0 in 0.668s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:20 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d is being set with open permissions: ugo+rw Jul 08 03:53:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:20 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d Jul 08 03:53:20 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:21 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d" returned: 0 in 0.621s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:21 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info Jul 08 03:53:21 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:21 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info" returned: 0 in 0.624s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:21 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info is being set with open permissions: ugo+rw Jul 08 03:53:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:21 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info Jul 08 03:53:21 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:22 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.info" returned: 0 in 0.617s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.100s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7dc7e3f5-c11e-4fa3-bf95-2dc38fb87ba5 tempest-ProjectReaderTests-12287965 None] Create snapshot completed successfully Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-e4e534a9-602c-474f-b31c-de87202f2e2d-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Lock "cinder-e4e534a9-602c-474f-b31c-de87202f2e2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-e4e534a9-602c-474f-b31c-de87202f2e2d" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-e4e534a9-602c-474f-b31c-de87202f2e2d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Deleting offline snapshot e4e534a9-602c-474f-b31c-de87202f2e2d of volume d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] snapshot_file for this snap is: volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b527bc5-1f78-4c0d-8055-c6008cddb1db]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:23 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:23 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d Jul 08 03:53:23 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:24 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d" returned: 0 in 0.734s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:24 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:53:24 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90aeb92-0b14-45e2-bbd0-d8bec6056873]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:24 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:24 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 Jul 08 03:53:24 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:25 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" returned: 0 in 0.731s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:25 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d Jul 08 03:53:25 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:25 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d" returned: 0 in 0.701s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:25 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:25 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d Jul 08 03:53:25 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:26 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8.e4e534a9-602c-474f-b31c-de87202f2e2d" returned: 0 in 0.662s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-e4e534a9-602c-474f-b31c-de87202f2e2d" released by "_delete_snapshot" :: held 2.916s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" released by "delete_snapshot" :: held 2.935s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Created reservations ['589377ea-82e7-4e6c-9569-6e7c5f2208ac', '5a0f21e2-b2c7-42be-bb57-089a607e3b70', 'a7a0a47e-eeb8-4df5-9967-a2b51dcf1ee2', 'f711c26b-fc33-4297-af87-4ce06542c830'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:26 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Delete snapshot completed successfully. Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-0fa44898-272c-4bb2-996c-651494140d3c tempest-ProjectReaderTests-12287965 None] Lock "cinder-e4e534a9-602c-474f-b31c-de87202f2e2d-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-d5283e2c-e77e-4a41-a0dc-4716c7889fb8-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Lock "cinder-d5283e2c-e77e-4a41-a0dc-4716c7889fb8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b841660-f3ce-435d-894c-9f157193c813]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:26 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:27 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 Jul 08 03:53:27 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:27 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" returned: 0 in 0.736s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:27 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:27 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8 Jul 08 03:53:27 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:28 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" returned: 0 in 0.636s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-d5283e2c-e77e-4a41-a0dc-4716c7889fb8" released by "delete_volume" :: held 1.426s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Created reservations ['98601416-8845-4f95-8611-f560e514f654', '07490348-e0e7-4685-980d-9315d62c5f63', 'acfa4e4d-6e54-49ca-b98e-00489f11a933', 'b279a5af-0550-4254-aa6a-3e67adc523b5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:28 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:28 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:53:28 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:29 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:53:29 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Deleted volume successfully. Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-e1f3b9dd-493f-4d14-8551-dfd53b38f572 tempest-ProjectReaderTests-12287965 None] Lock "cinder-d5283e2c-e77e-4a41-a0dc-4716c7889fb8-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (f6379cdd-cd28-4ca3-8c4e-7dc53cac0ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f517d5b3-e618-4ae0-8906-04665865f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f517d5b3-e618-4ae0-8906-04665865f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336394821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f42f48c-bd26-4348-9723-9f60c6ec3c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:29Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f1226b-a442-4587-92d5-43e9d4c4cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f1226b-a442-4587-92d5-43e9d4c4cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f60345f-0aae-4267-afb9-9deaa894cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f60345f-0aae-4267-afb9-9deaa894cdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f42f48c-bd26-4348-9723-9f60c6ec3c10', 'volume_name': 'volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53830cf3-fe7d-4f1c-b16f-b285518c960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53830cf3-fe7d-4f1c-b16f-b285518c960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e35eda0-0f41-4f36-ad9b-e46d5ae8c547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:29 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Volume 5f42f48c-bd26-4348-9723-9f60c6ec3c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10', 'volume_size': 1} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336394821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f42f48c-bd26-4348-9723-9f60c6ec3c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:29Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Creating volume 5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:53:29 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:53:29 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:29 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 1073741824 Jul 08 03:53:29 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:30 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 1073741824" returned: 0 in 0.789s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:30 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:30 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 Jul 08 03:53:30 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:31 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10" returned: 0 in 0.641s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:INSERT=22,cinder:UPDATE=90,cinder:SELECT=62,cinder:DELETE=4 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e35eda0-0f41-4f36-ad9b-e46d5ae8c547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634f2374-456e-4857-a293-c82f679614fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:31 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Volume volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 (5f42f48c-bd26-4348-9723-9f60c6ec3c10): created successfully Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634f2374-456e-4857-a293-c82f679614fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (f6379cdd-cd28-4ca3-8c4e-7dc53cac0ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:31 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-ac931a86-9624-4abc-8e82-6722f32b900b tempest-ProjectReaderTests-12287965 None] Created volume successfully. Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Creating offline snapshot 202f6018-34f1-471f-8e81-d62ae3cee0ee of volume 5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[78319ba1-c832-4c68-978c-4a5fcc31804f]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:31 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:31 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 Jul 08 03:53:31 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:32 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10" returned: 0 in 0.744s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:32 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee 1G Jul 08 03:53:32 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:33 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee 1G" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:33 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee Jul 08 03:53:33 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:33 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee" returned: 0 in 0.681s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:33 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee is being set with open permissions: ugo+rw Jul 08 03:53:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:33 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee Jul 08 03:53:33 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:34 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee" returned: 0 in 0.623s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:34 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info Jul 08 03:53:34 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:35 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:35 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info is being set with open permissions: ugo+rw Jul 08 03:53:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:35 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info Jul 08 03:53:35 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:35 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.info" returned: 0 in 0.644s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.191s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:35 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4fc73095-b3e5-46fb-b12e-8c291c3bc289 tempest-ProjectReaderTests-12287965 None] Create snapshot completed successfully Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-202f6018-34f1-471f-8e81-d62ae3cee0ee-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Lock "cinder-202f6018-34f1-471f-8e81-d62ae3cee0ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-5f42f48c-bd26-4348-9723-9f60c6ec3c10" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-5f42f48c-bd26-4348-9723-9f60c6ec3c10" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-202f6018-34f1-471f-8e81-d62ae3cee0ee" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-202f6018-34f1-471f-8e81-d62ae3cee0ee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Deleting offline snapshot 202f6018-34f1-471f-8e81-d62ae3cee0ee of volume 5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] snapshot_file for this snap is: volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b3196-1408-4eab-a6c7-b800c3a1e26a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:37 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee Jul 08 03:53:37 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:37 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:53:37 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c53fa2-d296-485e-b11c-854ef8d1fd08]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:37 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 Jul 08 03:53:37 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:38 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10" returned: 0 in 0.751s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:38 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee Jul 08 03:53:38 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:39 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:39 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee Jul 08 03:53:39 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:39 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10.202f6018-34f1-471f-8e81-d62ae3cee0ee" returned: 0 in 0.629s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-202f6018-34f1-471f-8e81-d62ae3cee0ee" released by "_delete_snapshot" :: held 2.966s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-5f42f48c-bd26-4348-9723-9f60c6ec3c10" released by "delete_snapshot" :: held 2.988s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=59,cinder:DELETE=9,cinder:INSERT=21,cinder:UPDATE=73 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:53:39 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Created reservations ['b1f30c81-2291-46e3-a58a-7f0f59a43e0d', '6517949e-09ec-4f7b-8c8b-fdaba121cf5a', '0723595c-0fd5-4f1c-9a64-3a2d85e3d6ef', '54627369-5362-4772-89c2-6ca96326942d'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:40 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Delete snapshot completed successfully. Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-8e05212c-5329-4d0a-a3c2-c0247e2b53fd tempest-ProjectReaderTests-12287965 None] Lock "cinder-202f6018-34f1-471f-8e81-d62ae3cee0ee-delete_snapshot" released by "delete_snapshot" :: held 3.130s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-5f42f48c-bd26-4348-9723-9f60c6ec3c10-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Lock "cinder-5f42f48c-bd26-4348-9723-9f60c6ec3c10-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-5f42f48c-bd26-4348-9723-9f60c6ec3c10" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-5f42f48c-bd26-4348-9723-9f60c6ec3c10" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d79e845-c0cc-477b-a037-d62c7f1c993a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:40 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 Jul 08 03:53:40 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:40 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10" returned: 0 in 0.737s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:40 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10 Jul 08 03:53:40 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:41 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-5f42f48c-bd26-4348-9723-9f60c6ec3c10" returned: 0 in 0.618s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-5f42f48c-bd26-4348-9723-9f60c6ec3c10" released by "delete_volume" :: held 1.408s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Created reservations ['f6bf9025-857a-4cc7-b3e2-3e1a70f5af8a', 'a2f3bd4d-15d9-4af9-b2ae-9d613b50729d', '70927ef2-e8be-4332-ac5b-88add8f84033', 'a7916d50-ebd6-4bcf-855b-371e24585840'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:41 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:53:41 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:42 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.617s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:53:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Deleted volume successfully. Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-fb283cda-431c-41c1-9521-cedfff35c6b3 tempest-ProjectReaderTests-12287965 None] Lock "cinder-5f42f48c-bd26-4348-9723-9f60c6ec3c10-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (55d2b82e-c0cc-4a78-9cee-37c14c1f43ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3204df8-452c-466b-86d8-e1b5bdae573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3204df8-452c-466b-86d8-e1b5bdae573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226138873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05aafed-35ad-4943-ae72-88c72649848c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:43Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbed033-68e8-4ad9-9faf-d0355b6a391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbed033-68e8-4ad9-9faf-d0355b6a391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c189573-fff2-4330-a4bd-6af37106db98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c189573-fff2-4330-a4bd-6af37106db98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05aafed-35ad-4943-ae72-88c72649848c', 'volume_name': 'volume-b05aafed-35ad-4943-ae72-88c72649848c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dadbb6-81e8-44dc-83ca-f6a2033afc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dadbb6-81e8-44dc-83ca-f6a2033afc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e258f499-7788-4765-8b50-ea3fe088b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:42 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Volume b05aafed-35ad-4943-ae72-88c72649848c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05aafed-35ad-4943-ae72-88c72649848c', 'volume_size': 1} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226138873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05aafed-35ad-4943-ae72-88c72649848c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:43Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Creating volume b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:53:42 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:53:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:42 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c 1073741824 Jul 08 03:53:42 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:43 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c 1073741824" returned: 0 in 0.776s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:43 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:43 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c Jul 08 03:53:43 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:44 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e258f499-7788-4765-8b50-ea3fe088b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05aafed-35ad-4943-ae72-88c72649848c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9657e924-6056-42d5-834d-21c8cad2b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:44 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Volume volume-b05aafed-35ad-4943-ae72-88c72649848c (b05aafed-35ad-4943-ae72-88c72649848c): created successfully Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9657e924-6056-42d5-834d-21c8cad2b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (55d2b82e-c0cc-4a78-9cee-37c14c1f43ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:44 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-64e7cff6-91ee-4b11-86d8-190c361de650 tempest-ProjectReaderTests-12287965 None] Created volume successfully. Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Creating offline snapshot 5ed19025-f561-4aad-a5de-a0eed92bafe0 of volume b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8e3699-1462-4ee0-93d5-f2aacdaf84b7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:44 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:45 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c Jul 08 03:53:45 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:45 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c" returned: 0 in 0.724s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:45 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 1G Jul 08 03:53:45 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:46 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 1G" returned: 0 in 0.777s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05aafed-35ad-4943-ae72-88c72649848c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:46 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05aafed-35ad-4943-ae72-88c72649848c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 Jul 08 03:53:46 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:47 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:53:47 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:47 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05aafed-35ad-4943-ae72-88c72649848c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0" returned: 0 in 0.690s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:47 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 is being set with open permissions: ugo+rw Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:47 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 Jul 08 03:53:47 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:47 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.663s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:53:47 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0" returned: 0 in 0.629s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:47 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info Jul 08 03:53:47 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:48 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info" returned: 0 in 0.644s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:48 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info is being set with open permissions: ugo+rw Jul 08 03:53:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:48 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info Jul 08 03:53:48 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:49 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.info" returned: 0 in 0.625s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.169s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-32d82478-7cd7-4bcf-b563-1dcaec09e3bb tempest-ProjectReaderTests-12287965 None] Create snapshot completed successfully Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-5ed19025-f561-4aad-a5de-a0eed92bafe0-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Lock "cinder-5ed19025-f561-4aad-a5de-a0eed92bafe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-b05aafed-35ad-4943-ae72-88c72649848c" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-b05aafed-35ad-4943-ae72-88c72649848c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-5ed19025-f561-4aad-a5de-a0eed92bafe0" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-5ed19025-f561-4aad-a5de-a0eed92bafe0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Deleting offline snapshot 5ed19025-f561-4aad-a5de-a0eed92bafe0 of volume b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] snapshot_file for this snap is: volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[655377b8-3ed0-4c6e-93c0-b42b560dc2da]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:50 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 Jul 08 03:53:50 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:50 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0" returned: 0 in 0.739s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b05aafed-35ad-4943-ae72-88c72649848c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa961aa2-f3a1-4e47-8326-24fa24e4f253]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:51 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c Jul 08 03:53:51 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:51 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c" returned: 0 in 0.764s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:51 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 Jul 08 03:53:51 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:52 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0" returned: 0 in 0.731s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:52 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0 Jul 08 03:53:52 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:53 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c.5ed19025-f561-4aad-a5de-a0eed92bafe0" returned: 0 in 0.624s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-5ed19025-f561-4aad-a5de-a0eed92bafe0" released by "_delete_snapshot" :: held 2.949s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-b05aafed-35ad-4943-ae72-88c72649848c" released by "delete_snapshot" :: held 2.971s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Created reservations ['8087575c-e957-4de8-9c97-2c2454c55fad', '3c08d69d-9068-4eda-882d-344bdb233411', 'c1e42bc8-5666-48cd-8f3e-b5a0e020a35d', '0a522ed1-abc3-4486-ba41-2a5dad55b42c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:53 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Delete snapshot completed successfully. Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d9449c84-dc5d-4e8d-bd44-659cf5d91bb6 tempest-ProjectReaderTests-12287965 None] Lock "cinder-5ed19025-f561-4aad-a5de-a0eed92bafe0-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-b05aafed-35ad-4943-ae72-88c72649848c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Lock "cinder-b05aafed-35ad-4943-ae72-88c72649848c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-b05aafed-35ad-4943-ae72-88c72649848c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-b05aafed-35ad-4943-ae72-88c72649848c" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e6fc3-5a81-49f4-b042-b602023663c6]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:53 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c Jul 08 03:53:53 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:54 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c" returned: 0 in 0.744s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:54 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c Jul 08 03:53:54 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:54 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-b05aafed-35ad-4943-ae72-88c72649848c" returned: 0 in 0.623s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-b05aafed-35ad-4943-ae72-88c72649848c" released by "delete_volume" :: held 1.427s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Created reservations ['c0d17fb6-14f0-41c3-bf9b-ae72b8e8bb8f', '9838f3fe-6a36-4792-be83-6c5cdfca00f6', 'b538dd4d-cb7b-4ea8-bc1d-09d674b69210', '10aebb8b-14ab-42da-9c8d-84f6968644cb'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:54 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:53:54 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:55 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:53:55 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Deleted volume successfully. Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-3fd25bd0-6d84-4829-9b50-65520c8c92aa tempest-ProjectReaderTests-12287965 None] Lock "cinder-b05aafed-35ad-4943-ae72-88c72649848c-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (065db358-9fd1-4dea-8ebe-838a36a37405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b69715-6089-4f14-8658-2ef5056663f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b69715-6089-4f14-8658-2ef5056663f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056955504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8648681f-be02-4bb0-b354-ec9e9bdecc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:56Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ab066-60d7-46d0-8686-04e1ad10fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ab066-60d7-46d0-8686-04e1ad10fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621382d9-fc80-4965-8752-053ff8b253ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621382d9-fc80-4965-8752-053ff8b253ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8648681f-be02-4bb0-b354-ec9e9bdecc1c', 'volume_name': 'volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46a9a4b-e63d-42bc-a874-0af7dcf8f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46a9a4b-e63d-42bc-a874-0af7dcf8f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cba519-3842-4fe5-9109-299ca440ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:56 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Volume 8648681f-be02-4bb0-b354-ec9e9bdecc1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c', 'volume_size': 1} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056955504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8648681f-be02-4bb0-b354-ec9e9bdecc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:53:56Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Creating volume 8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:53:56 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:56 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c 1073741824 Jul 08 03:53:56 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:56 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c 1073741824" returned: 0 in 0.798s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:56 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c Jul 08 03:53:56 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:57 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c" returned: 0 in 0.640s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cba519-3842-4fe5-9109-299ca440ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d962291-4cb8-4908-9642-add2e26acde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:53:57 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Volume volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c (8648681f-be02-4bb0-b354-ec9e9bdecc1c): created successfully Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d962291-4cb8-4908-9642-add2e26acde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:53:57 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (065db358-9fd1-4dea-8ebe-838a36a37405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:53:57 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-465d6fa4-9f0d-483c-b685-108a52a9981d tempest-ProjectReaderTests-12287965 None] Created volume successfully. Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Creating offline snapshot a6822cd4-b098-4fcd-b57e-fc639562ccf1 of volume 8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86aa0e-1bc8-4635-9af9-396d2786b83b]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:58 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c Jul 08 03:53:58 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:58 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c" returned: 0 in 0.744s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:58 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 1G Jul 08 03:53:58 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:53:59 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 08 03:53:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 1G" returned: 0 in 0.772s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:53:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:53:59 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 Jul 08 03:53:59 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:00 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:00 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 is being set with open permissions: ugo+rw Jul 08 03:54:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:00 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 Jul 08 03:54:00 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:00 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1" returned: 0 in 0.616s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:01 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info Jul 08 03:54:01 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:01 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info" returned: 0 in 0.649s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:01 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info is being set with open permissions: ugo+rw Jul 08 03:54:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:01 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info Jul 08 03:54:01 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:02 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.info" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.171s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:02 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f1e3c4ee-42c9-4141-a694-bdb698a1d88d tempest-ProjectReaderTests-12287965 None] Create snapshot completed successfully Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-a6822cd4-b098-4fcd-b57e-fc639562ccf1-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Lock "cinder-a6822cd4-b098-4fcd-b57e-fc639562ccf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-8648681f-be02-4bb0-b354-ec9e9bdecc1c" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-8648681f-be02-4bb0-b354-ec9e9bdecc1c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-a6822cd4-b098-4fcd-b57e-fc639562ccf1" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-a6822cd4-b098-4fcd-b57e-fc639562ccf1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Deleting offline snapshot a6822cd4-b098-4fcd-b57e-fc639562ccf1 of volume 8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] snapshot_file for this snap is: volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[519efa98-55fa-4321-8c08-cd72c2eb1179]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:03 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 Jul 08 03:54:03 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:04 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1" returned: 0 in 0.748s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:04 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:54:04 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a616e-003a-470c-9de2-504e71ac05dc]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:04 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c Jul 08 03:54:04 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:04 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c" returned: 0 in 0.735s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:04 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 Jul 08 03:54:04 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:05 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1" returned: 0 in 0.713s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:05 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:05 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1 Jul 08 03:54:05 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:06 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c.a6822cd4-b098-4fcd-b57e-fc639562ccf1" returned: 0 in 0.620s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-a6822cd4-b098-4fcd-b57e-fc639562ccf1" released by "_delete_snapshot" :: held 2.903s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-8648681f-be02-4bb0-b354-ec9e9bdecc1c" released by "delete_snapshot" :: held 2.924s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Created reservations ['93962c20-6066-49b7-b476-aaa7a47febdb', '8d61bb7c-6691-4b8a-a23a-aa733be92478', 'ad191d72-3b4f-4db6-ab6d-5912d2d952c1', '58fb97d3-fd55-4df8-b430-f2346320eebe'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:06 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Delete snapshot completed successfully. Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-38bf2fbb-d27c-47f0-a566-a1bce2b6e00f tempest-ProjectReaderTests-12287965 None] Lock "cinder-a6822cd4-b098-4fcd-b57e-fc639562ccf1-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-8648681f-be02-4bb0-b354-ec9e9bdecc1c-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Lock "cinder-8648681f-be02-4bb0-b354-ec9e9bdecc1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-8648681f-be02-4bb0-b354-ec9e9bdecc1c" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-8648681f-be02-4bb0-b354-ec9e9bdecc1c" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca641c1c-eb6d-43bb-9791-750969a366c7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:06 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:06 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c Jul 08 03:54:06 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:07 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c" returned: 0 in 0.731s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:07 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:07 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c Jul 08 03:54:07 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:08 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-8648681f-be02-4bb0-b354-ec9e9bdecc1c" returned: 0 in 0.665s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-8648681f-be02-4bb0-b354-ec9e9bdecc1c" released by "delete_volume" :: held 1.453s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Created reservations ['34d18fe3-df61-4bdd-bd92-d8d86252750d', 'abac4769-7ed0-4cf0-ab7d-6789cbf65799', 'fd9e91fd-e17b-436e-8430-e5db922715a6', '82bcfa1f-eb2f-46af-bebd-c76feb631795'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:08 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:08 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:08 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.638s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:08 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Deleted volume successfully. Jul 08 03:54:08 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-d91f7dbb-8d4e-4f81-9be0-4f1775a7ac70 tempest-ProjectReaderTests-12287965 None] Lock "cinder-8648681f-be02-4bb0-b354-ec9e9bdecc1c-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (2ec38789-43ff-4a52-a31e-c4c15dc53b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca9381d-7128-4b85-b492-813fb2008f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca9381d-7128-4b85-b492-813fb2008f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344875278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cbd572-257e-42fa-be49-bc287dd5209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:09Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42728d69-5c38-4008-b28e-7717a4b31b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42728d69-5c38-4008-b28e-7717a4b31b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b360c0e-8f8d-4c83-9f66-206c9a594690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b360c0e-8f8d-4c83-9f66-206c9a594690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47cbd572-257e-42fa-be49-bc287dd5209e', 'volume_name': 'volume-47cbd572-257e-42fa-be49-bc287dd5209e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3abecb-fc3f-4bab-87e9-cf9ea3442a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3abecb-fc3f-4bab-87e9-cf9ea3442a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a0d740-30ca-4467-b8b4-3d5bfa77d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:09 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Volume 47cbd572-257e-42fa-be49-bc287dd5209e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47cbd572-257e-42fa-be49-bc287dd5209e', 'volume_size': 1} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344875278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cbd572-257e-42fa-be49-bc287dd5209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc34da612a249f2aa031df622a71f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:09Z,use_quota=True,user_id='6d25e2daa6c645458221ea0797862e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Creating volume 47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:09 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:09 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:09 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e 1073741824 Jul 08 03:54:09 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:10 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e 1073741824" returned: 0 in 0.812s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:10 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e Jul 08 03:54:10 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:10 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e" returned: 0 in 0.619s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a0d740-30ca-4467-b8b4-3d5bfa77d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47cbd572-257e-42fa-be49-bc287dd5209e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b7954b-ed6e-45c5-a8a8-018e80ee2c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:10 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Volume volume-47cbd572-257e-42fa-be49-bc287dd5209e (47cbd572-257e-42fa-be49-bc287dd5209e): created successfully Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b7954b-ed6e-45c5-a8a8-018e80ee2c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:10 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Flow 'volume_create_manager' (2ec38789-43ff-4a52-a31e-c4c15dc53b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:10 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-aed6f5f4-4560-435b-9314-b2455aeec75a tempest-ProjectReaderTests-12287965 None] Created volume successfully. Jul 08 03:54:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:11 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Creating offline snapshot 861f3a62-cb90-4609-b70f-55dd9239019c of volume 47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 03:54:11 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f583681f-b612-4b66-9a46-d23d406828c7]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:11 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:11 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e Jul 08 03:54:11 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:12 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e" returned: 0 in 0.740s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c 1G {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:12 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c 1G Jul 08 03:54:12 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:12 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c 1G" returned: 0 in 0.788s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:12 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47cbd572-257e-42fa-be49-bc287dd5209e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:12 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47cbd572-257e-42fa-be49-bc287dd5209e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c Jul 08 03:54:12 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:13 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47cbd572-257e-42fa-be49-bc287dd5209e -F qcow2 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c" returned: 0 in 0.679s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:13 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c is being set with open permissions: ugo+rw Jul 08 03:54:13 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:13 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c Jul 08 03:54:13 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:14 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:14 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info Jul 08 03:54:14 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:14 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info" returned: 0 in 0.647s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:14 devstack cinder-volume[86294]: WARNING cinder.volume.drivers.remotefs [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info is being set with open permissions: ugo+rw Jul 08 03:54:14 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:14 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info Jul 08 03:54:14 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:15 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.info" returned: 0 in 0.651s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:15 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:15 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-a38807a0-d328-4010-8391-4252c435916a tempest-ProjectReaderTests-12287965 None] Create snapshot completed successfully Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-861f3a62-cb90-4609-b70f-55dd9239019c-delete_snapshot" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Lock "cinder-861f3a62-cb90-4609-b70f-55dd9239019c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-47cbd572-257e-42fa-be49-bc287dd5209e" by "delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-47cbd572-257e-42fa-be49-bc287dd5209e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-861f3a62-cb90-4609-b70f-55dd9239019c" by "_delete_snapshot" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-861f3a62-cb90-4609-b70f-55dd9239019c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Deleting offline snapshot 861f3a62-cb90-4609-b70f-55dd9239019c of volume 47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] snapshot_file for this snap is: volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c {{(pid=86294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de18ff5-f8e4-4adc-90a2-be96027dd690]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:16 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:16 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c Jul 08 03:54:16 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:17 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c" returned: 0 in 0.753s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:17 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47cbd572-257e-42fa-be49-bc287dd5209e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 03:54:17 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e870f44-76f6-40f5-88dd-e3aee9aecbdd]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:17 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:17 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e Jul 08 03:54:17 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:18 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e" returned: 0 in 0.728s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:18 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c Jul 08 03:54:18 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:18 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:18 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:18 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c Jul 08 03:54:18 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:19 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e.861f3a62-cb90-4609-b70f-55dd9239019c" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-861f3a62-cb90-4609-b70f-55dd9239019c" released by "_delete_snapshot" :: held 2.930s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-47cbd572-257e-42fa-be49-bc287dd5209e" released by "delete_snapshot" :: held 2.950s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Created reservations ['2f0fed61-b05a-491b-ba6b-dec3d4847461', '306809a3-580f-4c87-b7bb-9bb619f60f80', '4b593cf0-7346-4529-a869-800553ebe97d', 'cfe6d5ee-031e-4800-a7ac-154eb1205f4a'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:19 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Delete snapshot completed successfully. Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-9786b263-ac65-420b-8c66-de1199191d0b tempest-ProjectReaderTests-12287965 None] Lock "cinder-861f3a62-cb90-4609-b70f-55dd9239019c-delete_snapshot" released by "delete_snapshot" :: held 3.069s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-47cbd572-257e-42fa-be49-bc287dd5209e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Lock "cinder-47cbd572-257e-42fa-be49-bc287dd5209e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Acquiring lock "cinder-quobyte-47cbd572-257e-42fa-be49-bc287dd5209e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-47cbd572-257e-42fa-be49-bc287dd5209e" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5355440-bea8-4025-a82a-81a4e4be88b9]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:19 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:20 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e Jul 08 03:54:20 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:20 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e" returned: 0 in 0.739s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:20 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:20 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e Jul 08 03:54:20 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:21 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-47cbd572-257e-42fa-be49-bc287dd5209e" returned: 0 in 0.627s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Lock "cinder-quobyte-47cbd572-257e-42fa-be49-bc287dd5209e" released by "delete_volume" :: held 1.424s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Created reservations ['0559dc4a-ebf6-4f77-9913-b7a0b798962e', '2aa5839b-d4a2-4841-b991-2596bcae311f', '9f882b9f-0118-4461-9dfb-e04bdd16f69a', '0858f20e-f883-4e1e-aecc-8f84770de9f5'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:21 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:21 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:21 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:22 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:22 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.649s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:22 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:22 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Deleted volume successfully. Jul 08 03:54:22 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f5e39f44-2dd5-4881-91ae-845e81f620ec tempest-ProjectReaderTests-12287965 None] Lock "cinder-47cbd572-257e-42fa-be49-bc287dd5209e-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:31 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=70,cinder:DELETE=3 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:INSERT=24,cinder:SELECT=49,cinder:UPDATE=67,cinder:DELETE=7 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Flow 'volume_create_manager' (3717839b-3e73-4fba-aac0-8e1a756005b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d369452-fb06-42c6-900f-0191aa9a9ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d369452-fb06-42c6-900f-0191aa9a9ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972329900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6d600d-36bd-4594-ab92-66722c625d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f63ec594854e8d8a0e5f7689227888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:33Z,use_quota=True,user_id='0b5e29accb014b24a50507a0a12cf3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ddf09b-708b-45fd-b0ac-ea171d8133dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ddf09b-708b-45fd-b0ac-ea171d8133dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7fe3bf-c42e-408a-945c-d67c96903d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7fe3bf-c42e-408a-945c-d67c96903d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6d600d-36bd-4594-ab92-66722c625d35', 'volume_name': 'volume-bc6d600d-36bd-4594-ab92-66722c625d35', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bef6cc-3e04-4985-9948-a4e999b1180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bef6cc-3e04-4985-9948-a4e999b1180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92610872-03dd-446f-b72b-8d778d0867bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:32 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Volume bc6d600d-36bd-4594-ab92-66722c625d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6d600d-36bd-4594-ab92-66722c625d35', 'volume_size': 1} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972329900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6d600d-36bd-4594-ab92-66722c625d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f63ec594854e8d8a0e5f7689227888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:33Z,use_quota=True,user_id='0b5e29accb014b24a50507a0a12cf3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Creating volume bc6d600d-36bd-4594-ab92-66722c625d35 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:32 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:32 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:32 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 1073741824 Jul 08 03:54:32 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:33 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 1073741824" returned: 0 in 0.812s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:33 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:33 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 Jul 08 03:54:33 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:34 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35" returned: 0 in 0.636s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92610872-03dd-446f-b72b-8d778d0867bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6d600d-36bd-4594-ab92-66722c625d35', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84355969-5c47-4940-be40-17295774053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:34 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Volume volume-bc6d600d-36bd-4594-ab92-66722c625d35 (bc6d600d-36bd-4594-ab92-66722c625d35): created successfully Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84355969-5c47-4940-be40-17295774053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:34 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Flow 'volume_create_manager' (3717839b-3e73-4fba-aac0-8e1a756005b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:34 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3f625eb5-27ab-4cbc-b8b3-234c3e6d6aa7 tempest-ProjectReaderTests-567591331 None] Created volume successfully. Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Acquiring lock "cinder-bc6d600d-36bd-4594-ab92-66722c625d35-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Lock "cinder-bc6d600d-36bd-4594-ab92-66722c625d35-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Acquiring lock "cinder-quobyte-bc6d600d-36bd-4594-ab92-66722c625d35" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Lock "cinder-quobyte-bc6d600d-36bd-4594-ab92-66722c625d35" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e5352-70b6-407a-b50e-badffef94a6a]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:35 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 Jul 08 03:54:35 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:35 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35" returned: 0 in 0.735s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:35 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:35 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35 Jul 08 03:54:35 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:36 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-bc6d600d-36bd-4594-ab92-66722c625d35" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Lock "cinder-quobyte-bc6d600d-36bd-4594-ab92-66722c625d35" released by "delete_volume" :: held 1.407s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Created reservations ['506d5f66-e56d-4ba4-831a-3cbacf20891b', '3a6c35f9-5b76-475a-92f6-7468d3b522ca', 'b34f3d03-9691-4653-b8bb-69d3b21a792b', 'cf77e000-bd4a-4e4d-ae41-c29cd515c3a6'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:36 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:36 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:36 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:37 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.632s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:37 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Deleted volume successfully. Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-77e4b9ef-4dbc-4cdb-9108-bcc3d49e072c tempest-ProjectReaderTests-567591331 None] Lock "cinder-bc6d600d-36bd-4594-ab92-66722c625d35-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Flow 'volume_create_manager' (ebe00597-245e-4366-b624-7aa53228c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143631e6-f7d3-44c5-b59b-7dd80dfcf179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143631e6-f7d3-44c5-b59b-7dd80dfcf179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078292256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25144ea9-7af2-42f3-a418-eceff0aca529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f63ec594854e8d8a0e5f7689227888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:38Z,use_quota=True,user_id='0b5e29accb014b24a50507a0a12cf3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38ed1fd-fd0b-40f2-b7f7-37a5825c7dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38ed1fd-fd0b-40f2-b7f7-37a5825c7dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3217544a-58f9-4ab2-96d6-ae6d1975e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3217544a-58f9-4ab2-96d6-ae6d1975e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25144ea9-7af2-42f3-a418-eceff0aca529', 'volume_name': 'volume-25144ea9-7af2-42f3-a418-eceff0aca529', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c05a80-ba0d-426c-926f-b2e58d8a2246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c05a80-ba0d-426c-926f-b2e58d8a2246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de7cdbc-b0d5-416e-b332-5d0dc2692bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:37 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Volume 25144ea9-7af2-42f3-a418-eceff0aca529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25144ea9-7af2-42f3-a418-eceff0aca529', 'volume_size': 1} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078292256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25144ea9-7af2-42f3-a418-eceff0aca529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f63ec594854e8d8a0e5f7689227888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:38Z,use_quota=True,user_id='0b5e29accb014b24a50507a0a12cf3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Creating volume 25144ea9-7af2-42f3-a418-eceff0aca529 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:37 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:37 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:37 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 1073741824 Jul 08 03:54:37 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:38 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 1073741824" returned: 0 in 0.810s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:38 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:38 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 Jul 08 03:54:38 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:39 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529" returned: 0 in 0.617s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de7cdbc-b0d5-416e-b332-5d0dc2692bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25144ea9-7af2-42f3-a418-eceff0aca529', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e3c9b6-afaf-4946-9794-7273fe70d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:39 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Volume volume-25144ea9-7af2-42f3-a418-eceff0aca529 (25144ea9-7af2-42f3-a418-eceff0aca529): created successfully Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e3c9b6-afaf-4946-9794-7273fe70d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Flow 'volume_create_manager' (ebe00597-245e-4366-b624-7aa53228c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:39 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-3f16bf5a-f41c-4b67-afc8-1bf5d39a27b9 tempest-ProjectReaderTests-567591331 None] Created volume successfully. Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Acquiring lock "cinder-25144ea9-7af2-42f3-a418-eceff0aca529-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Lock "cinder-25144ea9-7af2-42f3-a418-eceff0aca529-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Acquiring lock "cinder-quobyte-25144ea9-7af2-42f3-a418-eceff0aca529" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Lock "cinder-quobyte-25144ea9-7af2-42f3-a418-eceff0aca529" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd3ab4-0a64-4a40-b02a-fb4ec362b0a5]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:39 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:39 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 Jul 08 03:54:39 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:40 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529" returned: 0 in 0.751s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:40 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:40 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529 Jul 08 03:54:40 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:41 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-25144ea9-7af2-42f3-a418-eceff0aca529" returned: 0 in 0.645s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Lock "cinder-quobyte-25144ea9-7af2-42f3-a418-eceff0aca529" released by "delete_volume" :: held 1.435s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Created reservations ['9bae9159-9222-4a99-a94f-053f9c717d26', 'd7ca8e8f-0aeb-40dc-9f83-4df963b6e944', '5e0fe13a-b9b8-470b-bc81-091125598f3c', '8d1eb46e-297a-402f-9c2b-68288b2dfbce'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:41 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:41 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:41 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:42 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:42 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.636s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:42 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:42 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Deleted volume successfully. Jul 08 03:54:42 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-1f3e8826-2d5c-4683-b8c0-cfaab0c59a14 tempest-ProjectReaderTests-567591331 None] Lock "cinder-25144ea9-7af2-42f3-a418-eceff0aca529-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (59660b86-5d0a-408b-8dbf-49379b20b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08207241-18e6-41b8-ba9c-18fa1ed11f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08207241-18e6-41b8-ba9c-18fa1ed11f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153683635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c8ba7-38d0-44cf-bdc2-be7fee483862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:46Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c3f019-0b2f-42e6-8c65-7b81b5b7c1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c3f019-0b2f-42e6-8c65-7b81b5b7c1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace10806-df45-4475-b44b-abb76533bf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace10806-df45-4475-b44b-abb76533bf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122c8ba7-38d0-44cf-bdc2-be7fee483862', 'volume_name': 'volume-122c8ba7-38d0-44cf-bdc2-be7fee483862', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71302270-03d2-4353-aea6-52cdafcc5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71302270-03d2-4353-aea6-52cdafcc5c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e57aee-79ab-47ce-8812-4a099e8ca92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:45 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Volume 122c8ba7-38d0-44cf-bdc2-be7fee483862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122c8ba7-38d0-44cf-bdc2-be7fee483862', 'volume_size': 1} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153683635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c8ba7-38d0-44cf-bdc2-be7fee483862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:46Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Creating volume 122c8ba7-38d0-44cf-bdc2-be7fee483862 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:45 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:45 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:45 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 1073741824 Jul 08 03:54:45 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:46 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 1073741824" returned: 0 in 0.811s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:46 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:46 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 Jul 08 03:54:46 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:47 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:47 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:47 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862" returned: 0 in 0.650s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e57aee-79ab-47ce-8812-4a099e8ca92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122c8ba7-38d0-44cf-bdc2-be7fee483862', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3dde45-1c6f-4114-9c8a-cd8fc88418cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:47 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Volume volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 (122c8ba7-38d0-44cf-bdc2-be7fee483862): created successfully Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3dde45-1c6f-4114-9c8a-cd8fc88418cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (59660b86-5d0a-408b-8dbf-49379b20b19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:47 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-d461a302-65c6-4dd2-84a5-af3a596050a2 tempest-ProjectReaderTests-415117327 None] Created volume successfully. Jul 08 03:54:47 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.649s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_service.periodic_task [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] Running periodic task VolumeManager._thread_info {{(pid=86294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread count: 28 {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-7c21c863-371b-4c18-857a-b98f7e1fa98e None None] thread info: [<_MainThread(MainThread, started 127282600153216)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-122c8ba7-38d0-44cf-bdc2-be7fee483862-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Lock "cinder-122c8ba7-38d0-44cf-bdc2-be7fee483862-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-quobyte-122c8ba7-38d0-44cf-bdc2-be7fee483862" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-122c8ba7-38d0-44cf-bdc2-be7fee483862" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[079be29d-467a-4b51-b2f0-36b909160de4]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:47 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:47 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 Jul 08 03:54:47 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:48 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862" returned: 0 in 0.729s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:48 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:48 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862 Jul 08 03:54:48 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:49 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-122c8ba7-38d0-44cf-bdc2-be7fee483862" returned: 0 in 0.629s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-122c8ba7-38d0-44cf-bdc2-be7fee483862" released by "delete_volume" :: held 1.397s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Created reservations ['36f46d89-48c5-47e6-a158-5ee90f8d6d38', 'dc92ed33-ab37-450d-9600-65e3eca7b5cf', 'f09ec6d9-e0da-421f-a76d-0679fca938bb', 'b81c9884-88f4-4685-a6bd-84aa9a6927da'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:49 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:49 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:49 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.640s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:49 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Deleted volume successfully. Jul 08 03:54:49 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-57ce50ce-a6fb-482a-b493-3b0c834c062a tempest-ProjectReaderTests-415117327 None] Lock "cinder-122c8ba7-38d0-44cf-bdc2-be7fee483862-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (c5ba9246-edc5-4e37-80dd-1d53490b2587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42bd07-a8d0-4e7e-904e-88e6165e6a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42bd07-a8d0-4e7e-904e-88e6165e6a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513570692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141122f0-fac5-48b5-9b75-985e0bdfef98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:50Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ed3e4d-c9b9-4d98-a322-9d6de984d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ed3e4d-c9b9-4d98-a322-9d6de984d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f62752a-667b-462a-a52d-6e50d4974696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f62752a-667b-462a-a52d-6e50d4974696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141122f0-fac5-48b5-9b75-985e0bdfef98', 'volume_name': 'volume-141122f0-fac5-48b5-9b75-985e0bdfef98', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9a23b9-1c7f-487f-a728-9dda286c27c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9a23b9-1c7f-487f-a728-9dda286c27c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c74062-1a74-42d9-afee-820d2f5cd3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:50 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Volume 141122f0-fac5-48b5-9b75-985e0bdfef98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141122f0-fac5-48b5-9b75-985e0bdfef98', 'volume_size': 1} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513570692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141122f0-fac5-48b5-9b75-985e0bdfef98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:50Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Creating volume 141122f0-fac5-48b5-9b75-985e0bdfef98 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:50 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:50 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:50 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 1073741824 Jul 08 03:54:50 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:51 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 1073741824" returned: 0 in 0.774s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:51 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 Jul 08 03:54:51 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:51 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98" returned: 0 in 0.624s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c74062-1a74-42d9-afee-820d2f5cd3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141122f0-fac5-48b5-9b75-985e0bdfef98', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e854f98-9803-4dd4-9d05-581678991ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:51 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Volume volume-141122f0-fac5-48b5-9b75-985e0bdfef98 (141122f0-fac5-48b5-9b75-985e0bdfef98): created successfully Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e854f98-9803-4dd4-9d05-581678991ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:51 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (c5ba9246-edc5-4e37-80dd-1d53490b2587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:51 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-0cdb215d-97cd-42dd-93ea-ecf6f5514769 tempest-ProjectReaderTests-415117327 None] Created volume successfully. Jul 08 03:54:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-141122f0-fac5-48b5-9b75-985e0bdfef98-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Lock "cinder-141122f0-fac5-48b5-9b75-985e0bdfef98-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-quobyte-141122f0-fac5-48b5-9b75-985e0bdfef98" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:52 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-141122f0-fac5-48b5-9b75-985e0bdfef98" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:52 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[035edacc-7b1b-42e8-8a80-595a11691f97]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:52 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:52 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 Jul 08 03:54:52 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:53 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98" returned: 0 in 0.723s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:53 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98 Jul 08 03:54:53 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:53 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:53 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-141122f0-fac5-48b5-9b75-985e0bdfef98" returned: 0 in 0.635s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:53 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-141122f0-fac5-48b5-9b75-985e0bdfef98" released by "delete_volume" :: held 1.396s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Created reservations ['9b75157d-1e6c-495a-a142-b8e1a7e57093', '92be64a8-b9bd-423f-aca9-2c532004a135', '839ced59-2a4c-4a31-9d5c-113c05a6f4ce', '8acb830e-f940-4d20-8010-2a3bc6b9b614'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:54 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:54 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:54 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:54 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Deleted volume successfully. Jul 08 03:54:54 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-7fe8ed25-6d2e-4a9d-bf9c-6df4eceed185 tempest-ProjectReaderTests-415117327 None] Lock "cinder-141122f0-fac5-48b5-9b75-985e0bdfef98-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (5a33dd60-5ae7-40af-a630-534f64ea2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d113ac1c-abbc-405b-8d78-95ecc5cdf0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d113ac1c-abbc-405b-8d78-95ecc5cdf0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500954164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0771b4a8-2fbc-410a-935d-684d44c9332e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:55Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe15399-22e7-4a09-8a92-159945c30dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe15399-22e7-4a09-8a92-159945c30dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cc7c72-9978-4f86-9c62-4914257bb128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cc7c72-9978-4f86-9c62-4914257bb128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0771b4a8-2fbc-410a-935d-684d44c9332e', 'volume_name': 'volume-0771b4a8-2fbc-410a-935d-684d44c9332e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec38d7-57d9-43b8-a3db-0256112554fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec38d7-57d9-43b8-a3db-0256112554fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52614c48-cacc-4222-bbcf-992ad5aa2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:55 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Volume 0771b4a8-2fbc-410a-935d-684d44c9332e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0771b4a8-2fbc-410a-935d-684d44c9332e', 'volume_size': 1} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500954164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0771b4a8-2fbc-410a-935d-684d44c9332e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:54:55Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Creating volume 0771b4a8-2fbc-410a-935d-684d44c9332e {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:55 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:55 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e 1073741824 Jul 08 03:54:55 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:55 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:55 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e 1073741824" returned: 0 in 0.783s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:56 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e Jul 08 03:54:56 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:56 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e" returned: 0 in 0.643s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52614c48-cacc-4222-bbcf-992ad5aa2670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0771b4a8-2fbc-410a-935d-684d44c9332e', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b83e515-25e4-4721-b527-8ff111020aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:56 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Volume volume-0771b4a8-2fbc-410a-935d-684d44c9332e (0771b4a8-2fbc-410a-935d-684d44c9332e): created successfully Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b83e515-25e4-4721-b527-8ff111020aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:56 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (5a33dd60-5ae7-40af-a630-534f64ea2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:56 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-87157583-a82b-48c9-8a9b-44f5af494725 tempest-ProjectReaderTests-415117327 None] Created volume successfully. Jul 08 03:54:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-0771b4a8-2fbc-410a-935d-684d44c9332e-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Lock "cinder-0771b4a8-2fbc-410a-935d-684d44c9332e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-quobyte-0771b4a8-2fbc-410a-935d-684d44c9332e" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:54:57 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-0771b4a8-2fbc-410a-935d-684d44c9332e" acquired by "delete_volume" :: waited 0.013s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:54:57 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8153c-2445-4bb1-8e82-c8dd20bf8887]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:54:57 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:57 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e Jul 08 03:54:57 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:58 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e" returned: 0 in 0.768s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:58 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e Jul 08 03:54:58 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:58 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-0771b4a8-2fbc-410a-935d-684d44c9332e" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-0771b4a8-2fbc-410a-935d-684d44c9332e" released by "delete_volume" :: held 1.444s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Created reservations ['72a2ac15-db40-4acc-91b7-ced1ffc7eaf3', '7d487b61-8963-45e5-9275-3aea6c0314be', 'f0b85d47-5b45-4e12-9991-67c392e8fbb3', '6d93f0a5-42a6-456d-b650-ab47247381d8'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:58 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:58 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:54:58 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:54:59 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.646s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:54:59 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Deleted volume successfully. Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-6299052e-78ce-47d0-8677-49d226806944 tempest-ProjectReaderTests-415117327 None] Lock "cinder-0771b4a8-2fbc-410a-935d-684d44c9332e-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (18d58e8d-6680-495d-b09a-a6e79e2777ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77ce558-d00b-45b4-b623-ce5181e18163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77ce558-d00b-45b4-b623-ce5181e18163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119867987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42733ed0-399d-4aa3-9983-2d08d4149733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:55:00Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb20343-ebcc-471a-aede-1b82c2aa2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb20343-ebcc-471a-aede-1b82c2aa2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95db8a77-d316-43be-ac17-8433fa7d66e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95db8a77-d316-43be-ac17-8433fa7d66e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42733ed0-399d-4aa3-9983-2d08d4149733', 'volume_name': 'volume-42733ed0-399d-4aa3-9983-2d08d4149733', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e8e691-b457-40a5-aee6-d24fb21a9043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e8e691-b457-40a5-aee6-d24fb21a9043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a2eb1a-2c89-4ca7-85f5-385c2ad10126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:54:59 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Volume 42733ed0-399d-4aa3-9983-2d08d4149733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42733ed0-399d-4aa3-9983-2d08d4149733', 'volume_size': 1} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T01:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119867987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42733ed0-399d-4aa3-9983-2d08d4149733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e0fbcd0704d7abce704ee0c260f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T01:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T01:55:00Z,use_quota=True,user_id='be88ddf051e0423a98bea1983ff948e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be03073f-36b5-4d2c-8f21-ce7515aa0b09),volume_type_id=be03073f-36b5-4d2c-8f21-ce7515aa0b09)}" {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.remotefs [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Creating volume 42733ed0-399d-4aa3-9983-2d08d4149733 {{(pid=86294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Selected osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df as target Quobyte volume. {{(pid=86294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 03:54:59 devstack cinder-volume[86294]: INFO cinder.volume.drivers.remotefs [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] casted to osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df Jul 08 03:54:59 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 1073741824 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:54:59 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 1073741824 Jul 08 03:54:59 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:55:00 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 08 03:55:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 1073741824" returned: 0 in 0.800s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:55:00 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:55:00 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 Jul 08 03:55:00 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:55:01 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733" returned: 0 in 0.633s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'} {{(pid=86294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a2eb1a-2c89-4ca7-85f5-385c2ad10126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42733ed0-399d-4aa3-9983-2d08d4149733', 'volume_size': 1}' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec45b9a8-8bc9-416d-be0e-eb26c7472184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 03:55:01 devstack cinder-volume[86294]: INFO cinder.volume.flows.manager.create_volume [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Volume volume-42733ed0-399d-4aa3-9983-2d08d4149733 (42733ed0-399d-4aa3-9983-2d08d4149733): created successfully Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec45b9a8-8bc9-416d-be0e-eb26c7472184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Flow 'volume_create_manager' (18d58e8d-6680-495d-b09a-a6e79e2777ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 03:55:01 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-4a469ba0-036e-4d23-9b92-d55b0e11da81 tempest-ProjectReaderTests-415117327 None] Created volume successfully. Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-42733ed0-399d-4aa3-9983-2d08d4149733-delete_volume" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:55:01 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Lock "cinder-42733ed0-399d-4aa3-9983-2d08d4149733-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:55:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Acquiring lock "cinder-quobyte-42733ed0-399d-4aa3-9983-2d08d4149733" by "delete_volume" {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 03:55:02 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-42733ed0-399d-4aa3-9983-2d08d4149733" acquired by "delete_volume" :: waited 0.014s {{(pid=86294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 03:55:02 devstack cinder-volume[86294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3733c37-f706-4e82-ab0a-36359524c485]: (4, 'qcow2') {{(pid=88194) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 03:55:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:55:02 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 Jul 08 03:55:02 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:55:02 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 08 03:55:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733" returned: 0 in 0.730s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:55:02 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:55:02 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733 Jul 08 03:55:02 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:55:03 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb/volume-42733ed0-399d-4aa3-9983-2d08d4149733" returned: 0 in 0.637s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Lock "cinder-quobyte-42733ed0-399d-4aa3-9983-2d08d4149733" released by "delete_volume" :: held 1.407s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG cinder.quota [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Created reservations ['079c2a88-ae7d-4635-9fbe-ff972c610a32', 'a39ad7eb-f8e7-44af-ac65-9827c6cdb2d8', 'ed8f10a6-623d-42ea-b46b-79c06075e80b', '7dacbfcd-270d-44d3-99cd-eb894cc6d41c'] {{(pid=86294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df': None} {{(pid=86294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG cinder.volume.drivers.quobyte [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6c853a02-dd94-4f9a-b800-b86981cf08df'] {{(pid=86294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.lockutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 03:55:03 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 03:55:03 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb Jul 08 03:55:03 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 03:55:04 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 08 03:55:04 devstack cinder-volume[86294]: DEBUG oslo_concurrency.processutils [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7bcc769e3fa7bee3f6812ed704db82cb" returned: 0 in 0.652s {{(pid=86294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 03:55:04 devstack cinder-volume[86294]: DEBUG cinder.manager [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Notifying Schedulers of capabilities ... {{(pid=86294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 03:55:04 devstack cinder-volume[86294]: INFO cinder.volume.manager [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Deleted volume successfully. Jul 08 03:55:04 devstack cinder-volume[86294]: DEBUG cinder.coordination [None req-f86f6f08-65f3-4a2d-b2ba-51c3a964d7b7 tempest-ProjectReaderTests-415117327 None] Lock "cinder-42733ed0-399d-4aa3-9983-2d08d4149733-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 03:55:13 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:UPDATE=70,cinder:SELECT=41,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 03:55:14 devstack cinder-volume[86294]: DEBUG dbcounter [-] [86294] Writing DB stats cinder:SELECT=43,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=18 {{(pid=86294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}